MCP Toolkit Benchmark: Arcade.dev vs Composio, A 100x Token Difference

In an analysis comparing the token consumption of two MCP toolkits, Arcade and Composio, within the Attio CRM sandbox environment, it was found that Arcade was significantly more efficient, consuming 7,426 tokens across eight CRM queries compared to Composio's 747,083 tokens, a difference of over 100 times. This disparity impacts infrastructure costs and agent reliability, as shown by detailed benchmarking involving identical queries run through both toolkits on the same CRM data, which included 50 companies, 100 contacts, and 50 deals. The efficiency gap is attributed to Arcade's ability to specify needed fields and streamline metadata, whereas Composio outputs full records and detailed API metadata, resulting in higher token usage. For agents performing complex workflows, Arcade's lower token usage offers substantial cost savings, with potential annual savings reaching up to $2 million at enterprise scales when considering the higher token prices of different models. This efficiency is crucial, as research indicates that long-context inputs can degrade performance, highlighting the importance of optimizing token usage in large-scale operations.