Building an AI Retail Assistant at the Edge with SLMs on Intel CPUs

The Edge IQ Retail Assistant exemplifies the transformative potential of AI-driven solutions in the retail sector by leveraging CPU-based edge computing to enhance store operations and customer interactions. It operates without GPUs, utilizing Intel Xeon 6 CPUs within a Cisco UCS server to process data locally, thereby addressing key retail challenges such as latency, resilience, data privacy, bandwidth efficiency, and cost predictability. The system integrates open-source small language models and real-time data analytics, allowing store associates to access information via voice or text on customer traffic and inventory from platforms like WaitTime and Chooch. This approach reduces network dependency, ensures continuous functionality during internet outages, and keeps sensitive data within store infrastructure. By using Intel's OpenVINO toolkit, the assistant optimizes AI models for CPU execution, demonstrating the significant advancements in AI optimization and the capabilities of modern server processors. As a result, the solution offers enhanced customer experiences, improved operational efficiency, and cost savings, positioning retailers to remain competitive in an evolving landscape.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.