llama.cpp/scripts/get-wikitext-103.sh

#!/bin/bash

wget https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-103-raw-v1.zip

echo "Usage:"
echo ""
echo "  ./llama-perplexity -m model.gguf -f wiki.test.raw [other params]"
echo ""

exit 0
lookup: complement data from context with general text statistics (#5479) * lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens 2024-03-23 01:24:36 +01:00			`#!/bin/bash`

			`wget https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-103-raw-v1.zip`

			`echo "Usage:"`
			`echo ""`
Prefix all example bins w/ llama- 2024-06-08 13:42:01 +01:00			`echo " ./llama-perplexity -m model.gguf -f wiki.test.raw [other params]"`
lookup: complement data from context with general text statistics (#5479) * lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens * fixup! lookup: evaluation tools, use corpus/previous gens 2024-03-23 01:24:36 +01:00			`echo ""`

			`exit 0`