The Edge GenAI Chatbot is a locally operated chatbot that runs directly on embedded devices, delivering fast, low-latency responses while ensuring enhanced privacy. Its modular software design allows flexibility across diverse hardware configurations, making it adaptable to specific application requirements. Additionally, it is compatible with a broad selection of TRIA System-on-Modules (SOMs) to optimize performance. Comprehensive software support is provided, offering robust resources and tools for seamless integration and customisation.
Demonstrated at electronica 2024, the Edge GenAI Chatbot allowed attendees to call a technical assistant, rewind to the 1950s or play a trivia game with a quiz master. Powered by a local 9 billion parameter LLM and seamlessly integrated into Tria embedded systems, this chatbot paves the way for innovative experiences.
Capabilities
- Natural Voice Interactions
- Conversational Understanding
- Conference Moderation
- Personal Assistance
- Real-Time Language Translation
- Automated Note-Taking
- Summarisation
Potential applications
- Conference Systems
- Hospitality (Check-in/check-out)
- Human-Machine Interfaces (HMIs)
- Collaborative Robots (Cobots)
- Industrial HMIs
- Retail & E-commerce
- Transportation
- Home Automation
Michael Uyttersprot demonstrates the Edge GenAI Chatbot at electronica 2024
Software architecture
Benefits
- Standalone Functionality: Performs independently, maintaining full capabilities without an internet connection
- Local Execution: Processes directly on the device, supporting continuous use anywhere
- Data Privacy & Security: Processes data locally, safeguarding sensitive information and minimising external risks
- Low Latency: Provides immediate responses by processing data directly on the device
- High Reliability: Delivers uninterrupted functionality, even in remote or offline environments
- Flexible Customisation: Adapts to specific business needs, providing personalised interactions and functionality
- Energy Efficiency: Designed for low power consumption, aligning with sustainability goals
AMD
Ryzen R2000 SMARC module
The AMD Ryzen™ R2000 SMARC module pared with the SimpleFlex EP5 Application-Ready Embedded Platform is a great starting point for your embedded design.
Need AI/ML support?Whether you have an AI/ML question for our team, or you're interested in one of our AI/ML solutions, you can get in touch with our experts here. |