SingleStore has made significant improvements to its ability to handle JSON data, particularly in cases of sparse JSON, which was a challenge for customers like Heap due to performance issues with data ingest and query performance. The new encoding engine provides fast seeks and supports a wider range of JSON data efficiently, addressing the issues of schema inference safeguards and compression challenges that were causing OOM errors during ingestion and scan operations. By optimizing memory allocation and introducing an intermediate interface to store NULLs in run-length format, SingleStore has achieved reliable and efficient handling of sparse JSON data, making it more user-friendly for developers generating JSON data in their applications.