MeetKai releases Functionary-V2.4: Alternative to OpenAI Function Call Model
Functional is a language model that can interpret and execute functions/plug-ins.
The model determines when functions are executed, whether parallel or serial, and their output can be understood. It triggers functions only on an as-needed basis. Function definitions are given in the form of JSON schema objects, similar to OpenAI GPT function calls.
Make sure you have PyTorch ( 2.1.2 ) installed. Then you need to install the required dependencies
You can now start the extremely fast vLLM server.
If you are experiencing problems with dependencies and you have nvidia-container-toolkit, you can start your environment:
The differences between OpenAI-python v0 and v1 can refer to the official documentation
Make sure llama-cpp-python is successfully installed on your system. Starting from v0.2.18, Functional v2 has been fully integrated into llama-cpp-python. You can complete your reasoning through normal chat or use Functional’s GGUF model through llama-cpp-python’s OpenAI-compatible server (which behaves similar to ours).
For more details, please refer to the function calls section in llama-cpp-python. To use llama-cpp-python’s OpenAI-compatible server to use our Functional GGUF model
use case
Travel and Hospitality Industry-Travel Planning: The function plan_trip can accept user input such as “I want to plan a 7-day trip to Paris with an emphasis on art and culture” and generate an itinerary accordingly.
Real Estate-Property Valuation: Functions like estimate_property_value allow users to enter detailed information about the property (such as location, size, number of rooms, etc.) and receive an estimated market value.
Telecommunications-Customer Support: The parse_customer_complaint function helps extract structured information from complex, narrative customer complaints and identify core issues and potential solutions. Complaint objects can contain attributes such as issue, frequency, and duration (how long the problem occurred).
Quick reading: https://marktechpost.com/2024/04/08/meetkai-releases-functionary-v2-4-an-alternative-to-openai-function-calling-models/
Github page: https://github.com/MeetKai/functionary
High-frequency Project-Small: https://huggingface.co/meetkai/functionary-small-v2.4
High-frequency Project-Middle: https://huggingface.co/meetkai/functionary-medium-v2.4
@meetkaiinc #ArtificialIntelligence
If you want to learn more, you can click on the link below the video.
Thank you for watching this video. If you like it, please subscribe and like it. thank
Video: