February 2021 Summaries

Here's a neutral, objective, and interesting summary of the text in one paragraph: The YugabyteDB community recently hosted a free "YSQL Development Fundamentals" training and certification class, which covered topics such as YugabyteDB architecture review, local installation, basic administration, and working with the YSQL shell. The course aimed to help beginners and intermediate SQL developers apply their PostgreSQL knowledge to YugabyteDB, with over 80 exercises to demonstrate this concept. Although some attendees found the exam moderately challenging, a near-perfect score was achieved by one community member, Hartanto Ario Widjaya, who became the first to pass. The training also addressed common questions about YugabyteDB, including its compatibility with PostgreSQL, data migration, and support for various tools and workloads. With several upcoming training sessions scheduled, interested individuals can continue to learn more about YugabyteDB's architecture, migration best practices, and development capabilities.

YugabyteDB is a cloud-native database that aims to reimagine the Relational Database Management System (RDBMS) for the cloud era. With 5 years of building experience, the database has evolved from its inception as a NoSQL database to incorporate features commonly found in RDBMSs, such as transactions and indexes. YugabyteDB's design is centered around high availability, horizontal scalability, and performance, making it suitable for applications with high traffic and data density requirements. The database supports distributed transactions without atomic clocks, using Hybrid Logical Clocks (HLCs), and achieves very high availability through active replicas that can take over as a new leader in a matter of seconds after the failure of the current leader. YugabyteDB is also designed to be highly performant, with optimizations for SSDs and NVMe drives, and leverages a customized version of RocksDB for scalability and performance. The database has gained significant traction among online retailers, financial institutions, and ISPs, who rely on it for high availability, scalability, and low latency responses. As the journey of YugabyteDB continues, exciting features are planned, including core database features, high throughput use-cases, and support for more APIs like SQL Server and MySQL.

This is the second post in a series about achieving GDPR compliance with YugabyteDB, a distributed SQL database. The EU's General Data Protection Regulation (GDPR) requires organizations to protect personal data and privacy of EU citizens, which can be achieved by building a sustainable GDPR process that focuses on central principles or best practices. Organizations should break down GDPR requirements into data protection principle "buckets" and assess their own compliance before building out their IT systems and governance framework. The role of maintaining GDPR compliance falls within the organization's C-Suite, particularly a Chief Data Officer, CISO, CTO, and/or CIO. Failing to maintain compliance can result in fines up to €20M or 4% of the organization's worldwide annual revenue from the prior fiscal year. Reaching GDPR compliance has benefits such as recognizing privacy as a fundamental human right and encouraging organizational privacy hygiene. YugabyteDB enables its customers to comply with GDPR requirements by providing features like geo-partitioning, replication, TLS encryption, and column-level security. The database has helped companies like Narvar serve the biggest names in ecommerce while staying GDPR compliant.

Enabling TLS encryption between clients and servers, as well as server-to-server communication in a distributed database like YugabyteDB, has a minimal impact on overall performance. Running TPC-C benchmarks with and without TLS encryption showed that throughput drops by less than 5%, average latency increases by around 15%, and CPU usage increases by about 6%. The efficiency of the workloads is also affected, but only within a 1-2% margin. While there may be some minor performance differences, enabling TLS encryption does not significantly impact the overall performance of the system.

The Average Dreamer` is a personal account of an individual's journey from working at Oracle to joining Yugabyte as a distributed systems engineer. The author reflects on their experiences, including job interviews with Kannan, one of the co-founders of Yugabyte, and their decision to join the company despite having multiple other job offers. They discuss the company culture, which emphasizes transparency, flexibility, and employee well-being, and how it has made a significant impact on their work experience. The author also shares their thoughts on the challenges of distributed systems engineering and how Yugabyte's products have helped solve some of these problems at scale. Overall, the story highlights the importance of listening to one's heart and taking risks in pursuit of personal growth and career satisfaction.

This series of posts aims to provide an overview of international compliance frameworks that companies encounter on their journeys with customers, and how YugabyteDB can be an essential part of a company's compliance efforts. Compliance frameworks are guidelines and best practices used by companies to establish internal controls to meet regulatory requirements, business objectives, privacy, and security standards. These frameworks come in various shapes and sizes, including cloud security, finance/corporate governance, information security and data protection, health information privacy/security, and more. Each framework has its own set of guidelines, baselines, and best practices to ensure companies meet regulatory requirements and protect sensitive data. The journey towards compliance is often ongoing due to the complexity of standards and frequent developments, making it essential for companies to stay informed and adapt their strategies accordingly.

YugabyteDB 2.4 has been released, providing enterprise-grade stability and scalability for mission-critical applications, including support for multi-region deployments, improved performance, and enhanced security features such as database CURSOR, third-party security audit, LDAP integration, audit logging, encryption in transit, data at rest encryption with Thales Vormetric, and Yugabyte Cloud. The new release also includes built-in support for Hasura GraphQL Engine, DBeaver, Apache Spark 3, VMware Tanzu integration, monitoring of SQL queries, and a roadmap for upcoming releases that include core database features, security enhancements, and enterprise features for Yugabyte Platform.

The text discusses the challenges of measuring performance in software development, particularly when making changes that may affect performance. It highlights the importance of regular testing for performance regressions and the need to interpret measurements accurately. The authors introduce the concept of statistical hypothesis testing, specifically the Student's t-test, to determine if changes have a statistically significant impact on performance. This approach helps to avoid human bias and provides a way to objectively evaluate changes, making it easier to "love low p-values" and confidently reject null hypotheses.

YugabyteDB has a feature for strongly consistent secondary indexes, but modifying existing indexes is not currently possible through the Yugabyte CQL API. However, there are ways to achieve this without taking downtime or restarting applications. One approach is to drop and recreate the index with the desired columns, which can take time and potentially affect application performance. Another approach is to create a new index first, including additional columns using the INCLUDE clause, and then dropping the old index once it has backfilled. This second approach avoids potential issues with disk space usage and write penalties, but still requires testing in a lower environment before production deployment.

Applying Legal Design Thinking to the Software Development Process is about integrating legal compliance into the product development process, allowing companies to innovate while ensuring business success. It combines design thinking, agile software development methodology, and legal methodologies to develop user-centric solutions and innovations. The process involves taking operability and compliance into account in parallel with the use case, which can propel proving the use case. It categorizes product development efforts into three buckets: use case, operability, and compliance, where compliance is highly context-dependent and may include security reviews, internal policy compliance, or pen-testing. Embedding legal design into the software development process involves high-level team discussions, ranking compliance issues based on risk and consequence, preparing a legal roadmap, providing training, and having regular meetings with key people in leadership to ensure adaptability. This approach turns out to be not only the right thing to do but also cheaper in the end, as building compliance after the product is hardened can cause unnecessary costs and pain to remediate.

Distributed SQL Summit Asia 2021 Recap and Highlights` was a virtual event that took place from January 20-22, 2021, with over 750 attendees, 35 speakers, and 900 minutes of content produced across three days. The event featured keynote presentations from Walmart, Weaveworks, and HashiCorp, as well as informative sessions from other innovative companies. A significant aspect of the event was the virtual swag donation program, where $5 USD was donated for every attendee who selected a charity, resulting in over $2,000 USD being donated to three charities. The audience played an active role in engaging with the speakers and content through live Q&A, comments, and feedback, which were highly valued by the organizers. The event recordings are available on Vimeo and YouTube for those who missed it or want to rewatch some of their favorites.

As a Yugabyte software engineering intern, I embarked on a journey that began with a call to adventure, where my enthusiasm for distributed databases was sparked by my team lead's side project. The internship process consisted of a short application and interview, which led me to accept the offer. However, due to the pandemic, the start date was delayed until June. Upon joining the team, I met my mentor, Rahul, who provided guidance and support throughout my internship. I worked on various projects, including load balancer improvements, enhancements for colocated tables, and other tasks that allowed me to learn about distributed systems and databases. The internship came to an end, but I'm proud of what I accomplished and the experience I gained, which has strengthened my passion for distributed systems and databases.