August 2011 Summaries

Graph processing is a technique used to analyze and process large amounts of data that are stored in a non-relational format, typically in the form of nodes and edges. Unlike graph databases, which focus on storing and querying connected data for online transaction processing, graph processing platforms like Pregel or Hadoop are better suited for niche problems where high latency can be tolerated in exchange for higher throughput. Graph databases, such as Neo4j, optimize storage and querying of connected data for online transaction processing scenarios, providing deep insights in near real-time at enterprise scale. The choice between graph processing and graph databases depends on the specific needs of the application, including requirements for insight, latency, and scalability.

The Spring Data Graph project has released version 1.1.0, which includes improved Neo4j support with enhanced querying capabilities, including Cypher and Gremlin scripts. The new release provides a more fluent API for advanced query result handling and supports dynamic field annotations and entity methods. The repository interface allows developers to execute Cypher queries and Gremlin scripts using the `@Query` annotation, enabling more expressive power in graph database development. The project also includes support for remote Neo4j-REST-Server querying and a REST API wrapper with internal refreshment. The collaboration between SpringSource and Neo-Technology teams was enjoyable, and the community's valuable feedback and contributions were greatly appreciated. The future roadmap includes a webinar on September 8th, rebranding as "Spring Data Neo4j", an additional mapping-based implementation without AspectJ, and a remote REST-API that will become more important with hosted Neo4j services at PaaS providers.

Neo4j is a graph database that allows users to store and query data in the form of nodes and relationships, enabling complex queries and data modeling. The Neo4j community has developed various tools and libraries to work with the database, including Cypher for querying, Gremlin for scripting, and TinkerPop for interacting with RDF. Auto-indexing is a feature that automatically adds indexing entries based on specific node properties, while SPARQL is a query language specifically for RDF. Users can run webadmin, a debugging tool, to explore graph details, or use external tools like Gephi for more elaborate graph visualization. The Neo4j ecosystem includes a vibrant community of developers who create complementary products, and the company plans to highlight prominent projects and provide special content on their website. Aggregation operations are possible with both Cypher and Gremlin, while deleting nodes is a single node operation that can be scripted using Gremlin. Specifying relationships between relationships is an interesting suggestion being considered by Neo4j's developers, and embedding Neo4j in Android apps requires some effort but has been discussed on the mailing list. Clustering handles simultaneous writes through serialization of transactions, and users can ensure transactions are in sync with the database using external transaction managers. Examples of multi-relation queries demonstrate how to add multiple relationships to a graph, and users can learn more about graph databases by downloading O'Reilly's Graph Databases ebook.

Heroku has released a new Neo4j Graph Database Add-On, making it a language polyglot platform. This add-on is now available to all registered beta-testers of the Heroku PAAS platform and can be used for free with the test plan. The Neo4j-Graph Database serves as a type of NOSQL datastore suited for interconnected data, storing content as nodes connected via relationships. It has constant time query characteristics for local data access, independent of data set size, making it suitable for highly dynamic domains. Provisioning a Neo4j Server instance can be done by adding the add-on to an application and is available through Heroku's command-line interface or configuration settings. The Neo4j Add-On contains features like backup and restore functionality, providing datasets for users to explore larger graphs right away. Additionally, it supports Ruby server-side extensions, allowing developers to extend behavior of the server in other languages than Java, using JRuby on the server to run rack-applications packaged as ruby gems.

Neo4j 1.4.1 GA has been released, featuring improved predictability with index data visibility, enhanced large backup support, more cross-platform server scripts, and bug fixes for various issues including relationship counts, null pointer exceptions, and file handling.