- 🔭 I’m currently working on a lot of C# projects
- 🌱 I’m currently learning a lot of things
- 👯 I’m looking to collaborate on some cool projects
- 🤔 I’m looking for help with a lot of things
- 💬 Ask me about C#, Pascal, C, System Administration, and DevOps
- 📫 How to reach me: turrican(at)hotmail.com
- ⚡ Fun fact: I like to play games (board games, computer games)
System Information:
- Total memory size: 63.87 GB
- CPU Info: Genuine Intel(R) 0000
- GPU Info: NVIDIA GeForce RTX 3070
- OS Version: Microsoft Windows 11 Pro
- Ollama Version: 0.4.7
LLM Models File Path:
C:\Python312\Lib\site-packages\llm_benchmark\data\benchmark_models_16gb_ram.yml
LLM Models Evaluation:
mistral:7b
- Write a step-by-step guide on how to bake a chocolate cake from scratch: 78.34 tokens/s
- Develop a python function that solves the following problem, sudoku game: 78.63 tokens/s
- Create a dialogue between two characters that discusses economic crisis: 79.16 tokens/s
- In a forest, there are brave lions living there. Please continue the story: 79.62 tokens/s
- I'd like to book a flight for 4 to Seattle in U.S.: 79.39 tokens/s
- Average Eval Rate: 79.028 tokens/s
llama3.1:8b
- Write a step-by-step guide on how to bake a chocolate cake from scratch: 68.25 tokens/s
- Develop a python function that solves the following problem, sudoku game: 68.00 tokens/s
- Create a dialogue between two characters that discusses economic crisis: 68.35 tokens/s
- In a forest, there are brave lions living there. Please continue the story: 68.73 tokens/s
- I'd like to book a flight for 4 to Seattle in U.S.: 69.99 tokens/s
- Average Eval Rate: 68.664 tokens/s
phi3:3.8b
- Write a step-by-step guide on how to bake a chocolate cake from scratch: 109.34 tokens/s
- Develop a python function that solves the following problem, sudoku game: 122.89 tokens/s
- Create a dialogue between two characters that discusses economic crisis: 114.13 tokens/s
- In a forest, there are brave lions living there. Please continue the story: 125.96 tokens/s
- I'd like to book a flight for 4 to Seattle in U.S.: 129.71 tokens/s
- Average Eval Rate: 120.406 tokens/s
qwen2:7b
- Write a step-by-step guide on how to bake a chocolate cake from scratch: 76.84 tokens/s
- Develop a python function that solves the following problem, sudoku game: 76.51 tokens/s
- Create a dialogue between two characters that discusses economic crisis: 77.09 tokens/s
- In a forest, there are brave lions living there. Please continue the story: 77.03 tokens/s
- I'd like to book a flight for 4 to Seattle in U.S.: 77.29 tokens/s
- Average Eval Rate: 76.952 tokens/s
gemma2:9b
- Explain Artificial Intelligence and give its applications: 22.90 tokens/s
- How are machine learning and AI related?: 23.33 tokens/s
- What is Deep Learning based on?: 22.31 tokens/s
- What is the full form of LSTM?: 25.84 tokens/s
- What are different components of GAN?: 23.14 tokens/s
- Average Eval Rate: 23.504 tokens/s
llava:7b
- Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample1.jpg: 81.02 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample2.jpg: 80.65 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample3.jpg: 81.37 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample4.jpg: 80.92 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample5.jpg: 81.23 tokens/s - Average Eval Rate: 81.038 tokens/s
llava:13b
- Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample1.jpg: 10.68 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample2.jpg: 9.85 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample3.jpg: 9.04 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample4.jpg: 8.78 tokens/s - Describe the image,
C:\Python312\Lib\site-packages\llm_benchmark\data\img\sample5.jpg: 8.77 tokens/s - Average Eval Rate: 9.424 tokens/s