From f676c691a3c4b174151ba1b31547bbf8a4c134fb Mon Sep 17 00:00:00 2001 From: Sanjay S Kumar <35188255+Quantaindew@users.noreply.github.com> Date: Tue, 2 Jul 2024 14:23:11 +0530 Subject: [PATCH 1/2] Fix false flags used in termux demo in README.md The flag `-cml` used in the example in the readme for the termux android interactive is incorrect, that flag is either depreciated or an error --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 3569b2bbb5e34..f32fedb19c82a 100644 --- a/README.md +++ b/README.md @@ -876,7 +876,7 @@ $mv /sdcard/llama.cpp/llama-2-7b-chat.Q4_K_M.gguf /data/data/com.termux/files/ho Now, you can start chatting: ``` $cd /data/data/com.termux/files/home/bin -$./llama-cli -m ../model/llama-2-7b-chat.Q4_K_M.gguf -n 128 -cml +$./llama-cli -m ../model/llama-2-7b-chat.Q4_K_M.gguf -n 128 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt ``` Here's a demo of an interactive session running on Pixel 5 phone: From 5b2736d9496c2a8d5aeafb126cc6a99574aebaff Mon Sep 17 00:00:00 2001 From: Sanjay S Kumar <35188255+Quantaindew@users.noreply.github.com> Date: Tue, 2 Jul 2024 22:52:53 +0530 Subject: [PATCH 2/2] add suggested updates to README.md Co-authored-by: Xuan Son Nguyen --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index f32fedb19c82a..33319b7eb2dc8 100644 --- a/README.md +++ b/README.md @@ -876,7 +876,7 @@ $mv /sdcard/llama.cpp/llama-2-7b-chat.Q4_K_M.gguf /data/data/com.termux/files/ho Now, you can start chatting: ``` $cd /data/data/com.termux/files/home/bin -$./llama-cli -m ../model/llama-2-7b-chat.Q4_K_M.gguf -n 128 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt +$./llama-cli -m ../model/llama-2-7b-chat.Q4_K_M.gguf -cnv ``` Here's a demo of an interactive session running on Pixel 5 phone: