Versions of the OpenAssist Dataset for chat fine-tuning different models. See https://youtu.be/71x8EMrB0Gc for a full video run through of methods.
Trelis
company
AI & ML interests
Function Calling. Quantizing. Fine-Tuning. Summarizing. Long-context Length.
Organization Card
About org cards
last updated Feb 16th 2024
About
Trelis Research provides:
- Function-calling models.
- Advanced LLM fine-tuning scripts.
- Advanced LLM inference guides.
- Advanced vision fine-tuning scripts.
- Advanced voice/transcription fine-tuning scripts.
- One click LLM API templates
Function-calling Models and Datasets
- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. Collection here
- Dataset to fine-tune models for function calling. Access here
- Scripts to fine-tune models for function calling and structured responses.
ADVANCED Fine-tuning Scripts
- Unsupervised + Supervised Fine-tuning Notebooks
- Chat fine-tuning scripts
- Long context fine-tuning scripts
- Function calling fine-tuning
- Q&A Dataset Preparation + Cleaning Scripts
- Scripts to create and use Embeddings
- Quantization Scripts
ADVANCED Inference
- Server setup, API setup and inference guide for open source models.
- Inference for function calling.
ADVANCED Vision
- Dataset Preparation
- Fine-tuning Llava and IDEFICS
ADVANCED Transcription
- Fine-tuning Whisper on custom datasets
- Dataset Generation
- Evaluation
One-click LLM API/Server Templates
- Check out the full list here
- Includes Llama 70B, Mistral 7B, Mixtral 8x7B and many more
Collections
2
Models fine-tuned for function-calling
-
Trelis/Meta-Llama-3-70B-Instruct-function-calling
Text Generation • Updated • 28 • 5 -
Trelis/Meta-Llama-3-8B-Instruct-function-calling
Text Generation • Updated • 623 • 10 -
Trelis/openchat_3.5-function-calling-v3
Text Generation • Updated • 14 • 18 -
Trelis/Llama-2-7b-chat-hf-function-calling-v3
Text Generation • Updated • 621 • 34
models
112
Trelis/Meta-Llama-3-8B-Instruct-function-calling
Text Generation
•
Updated
•
623
•
10
Trelis/Meta-Llama-3-8B-Instruct-forced-french-adapters
Updated
Trelis/Meta-Llama-3-8B-Instruct-no-fin-advice-adapters
Updated
Trelis/Phi-3-mini-128k-instruct-function-calling
Text Generation
•
Updated
•
326
•
2
Trelis/Meta-Llama-3-70B-Instruct-function-calling
Text Generation
•
Updated
•
28
•
5
Trelis/Mixtral-8x7B-Instruct-v0.1-function-calling-adapters-v3
Updated
•
1
Trelis/TinyLlama-chat-SFT
Text Generation
•
Updated
•
2.41k
Trelis/Mistral-7B-v0.1-chat-SFT
Text Generation
•
Updated
•
8
Trelis/Mistral-7B-v0.1-chat-ORPO
Text Generation
•
Updated
•
9
Trelis/TinyLlama-chat-ORPO-beta0.2
Text Generation
•
Updated
•
13
datasets
26
Trelis/englishQ_germanA
Viewer
•
Updated
•
42
•
1
Trelis/oasst2_top1_chat_format_fr
Viewer
•
Updated
•
3
Trelis/oasst2_top1_chat_format_en
Viewer
•
Updated
•
1
•
2
Trelis/function_calling_v3
Updated
•
348
•
33
Trelis/touch-rugby-memorisation-simple
Viewer
•
Updated
Trelis/touch-rugby-rules-memorisation
Viewer
•
Updated
•
26
Trelis/chess_pieces
Viewer
•
Updated
•
373
•
3
Trelis/llm-lingo
Viewer
•
Updated
•
119
•
2
Trelis/openassistant-deepseek-coder
Viewer
•
Updated
•
2
•
2
Trelis/function_calling_v3_SAMPLE
Viewer
•
Updated
•
23
•
1