Skip to content

Commit c1e5c83

Browse files
committed
Merge 'origin/master' into hipblas
2 parents 35a6031 + 447ccbe commit c1e5c83

File tree

4 files changed

+401
-34
lines changed

4 files changed

+401
-34
lines changed

README.md

+3-1
Original file line numberDiff line numberDiff line change
@@ -5,13 +5,15 @@
55
[![Actions Status](https://github.com/ggerganov/llama.cpp/workflows/CI/badge.svg)](https://github.com/ggerganov/llama.cpp/actions)
66
[![License: MIT](https://img.shields.io/badge/license-MIT-blue.svg)](https://opensource.org/licenses/MIT)
77

8+
[Roadmap](https://github.com/users/ggerganov/projects/7) / [Manifesto](https://github.com/ggerganov/llama.cpp/discussions/205) / [ggml](https://github.com/ggerganov/ggml)
9+
810
Inference of [LLaMA](https://arxiv.org/abs/2302.13971) model in pure C/C++
911

1012
**Hot topics:**
1113

14+
- New roadmap: https://github.com/users/ggerganov/projects/7
1215
- Azure CI brainstorming: https://github.com/ggerganov/llama.cpp/discussions/1985
1316
- p1 : LLM-based code completion engine at the edge : https://github.com/ggml-org/p1/discussions/1
14-
- Roadmap June 2023: https://github.com/ggerganov/llama.cpp/discussions/1729
1517

1618
<details>
1719
<summary>Table of Contents</summary>

examples/server/server.cpp

+1-1
Original file line numberDiff line numberDiff line change
@@ -325,10 +325,10 @@ struct llama_server_context {
325325
id = llama_sample_token_mirostat_v2(ctx, &candidates_p, mirostat_tau, mirostat_eta, &mirostat_mu);
326326
} else {
327327
// Temperature sampling
328+
llama_sample_top_k(ctx, &candidates_p, top_k, 1);
328329
llama_sample_tail_free(ctx, &candidates_p, tfs_z, 1);
329330
llama_sample_typical(ctx, &candidates_p, typical_p, 1);
330331
llama_sample_top_p(ctx, &candidates_p, top_p, 1);
331-
llama_sample_top_k(ctx, &candidates_p, top_k, 1);
332332
llama_sample_temperature(ctx, &candidates_p, temp);
333333
id = llama_sample_token(ctx, &candidates_p);
334334
}

0 commit comments

Comments
 (0)