Apache Cassandra
Cassandra is a free and open-source, distributed, wide-column store, NoSQL database management system designed to handle large amounts of data across many commodity servers, providing high availability with no single point of failure. Cassandra offers support for clusters spanning multiple datacenters,[2] with asynchronous masterless replication allowing low latency operations for all clients. Cassandra was designed to implement a combination of Amazon's Dynamo distributed storage and replication techniques combined with Google's Bigtable data and storage engine model.[3]
Original author(s) | Avinash Lakshman, Prashant Malik / Facebook |
---|---|
Developer(s) | Apache Software Foundation |
Initial release | July 2008 |
Stable release | 4.0.7[1]
/ 23 October 2022 |
Repository | |
Written in | Java |
Operating system | Cross-platform |
Available in | English |
Type | NoSQL Database, data store |
License | Apache License 2.0 |
Website | cassandra |
History
Avinash Lakshman, one of the authors of Amazon's Dynamo, and Prashant Malik initially developed Cassandra at Facebook to power the Facebook inbox search feature. Facebook released Cassandra as an open-source project on Google code in July 2008.[4] In March 2009, it became an Apache Incubator project.[5] On February 17, 2010, it graduated to a top-level project.[6]
Facebook developers named their database after the Trojan mythological prophet Cassandra, with classical allusions to a curse on an oracle.[7]
Releases
Releases after graduation include
- 0.6, released Apr 12 2010, added support for integrated caching, and Apache Hadoop MapReduce[8]
- 0.7, released Jan 08 2011, added secondary indexes and online schema changes[9]
- 0.8, released Jun 2 2011, added the Cassandra Query Language (CQL), self-tuning memtables, and support for zero-downtime upgrades[10]
- 1.0, released Oct 17 2011, added integrated compression, leveled compaction, and improved read-performance[11]
- 1.1, released Apr 23 2012, added self-tuning caches, row-level isolation, and support for mixed ssd/spinning disk deployments[12]
- 1.2, released Jan 2 2013, added clustering across virtual nodes, inter-node communication, atomic batches, and request tracing[13]
- 2.0, released Sep 4 2013, added lightweight transactions (based on the Paxos consensus protocol), triggers, improved compactions
- 2.1 released Sep 10 2014[14]
- 2.2 released July 20, 2015
- 3.0 released November 11, 2015
- 3.1 through 3.10 releases were monthly releases using a tick-tock-like release model, with even-numbered releases providing both new features and bug fixes while odd-numbered releases will include bug fixes only.[15]
- 3.11 released June 23, 2017 as a stable 3.11 release series and bug fix from the last tick-tock feature release.
- 4.0 released July 26, 2021.
- 4.0.1 released September 7, 2021.
- 4.0.2 released February 8, 2022.
- 4.0.3 released February 17, 2022.
- 4.0.4 released May 13, 2022.
- 4.0.5 released July 18, 2022.
- 4.0.6 released August 25, 2022.
- 4.0.7 released October 23, 2022.
Version | Original release date | Latest version | Release date | Status[16] |
---|---|---|---|---|
0.6 | 2010-04-12 | 0.6.13 | 2011-04-18 | No longer maintained |
0.7 | 2011-01-10 | 0.7.10 | 2011-10-31 | No longer maintained |
0.8 | 2011-06-03 | 0.8.10 | 2012-02-13 | No longer maintained |
1.0 | 2011-10-18 | 1.0.12 | 2012-10-04 | No longer maintained |
1.1 | 2012-04-24 | 1.1.12 | 2013-05-27 | No longer maintained |
1.2 | 2013-01-02 | 1.2.19 | 2014-09-18 | No longer maintained |
2.0 | 2013-09-03 | 2.0.17 | 2015-09-21 | No longer maintained |
2.1 | 2014-09-16 | 2.1.22 | 2020-08-31 | No longer maintained |
2.2 | 2015-07-20 | 2.2.19 | 2020-11-04 | No longer maintained |
3.0 | 2015-11-09 | 3.0.28 | 2022-05-13 | Still supported |
3.11 | 2017-06-23 | 3.11.14 | 2022-05-13 | Still supported |
4.0 | 2021-07-26 | 4.0.7 | 2022-08-25 | Latest release |
4.1 | 2022-10-05 | 4.1-beta1 | 2022-10-05 | Beta |
Legend: Old version Older version, still maintained Latest version Latest preview version |
Main features
- Distributed
- Every node in the cluster has the same role. There is no single point of failure. Data is distributed across the cluster (so each node contains different data), but there is no master as every node can service any request.
- Supports replication and multi data center replication
- Replication strategies are configurable.[17] Cassandra is designed as a distributed system, for deployment of large numbers of nodes across multiple data centers. Key features of Cassandra’s distributed architecture are specifically tailored for multiple-data center deployment, for redundancy, for failover and disaster recovery.
- Scalability
- Designed to have read and write throughput both increase linearly as new machines are added, with the aim of no downtime or interruption to applications.
- Fault-tolerant
- Data is automatically replicated to multiple nodes for fault-tolerance. Replication across multiple data centers is supported. Failed nodes can be replaced with no downtime.
- Tunable consistency
- Cassandra is typically classified as an AP system, meaning that availability and partition tolerance are generally considered to be more important than consistency in Cassandra,[18] Writes and reads offer a tunable level of consistency, all the way from "writes never fail" to "block for all replicas to be readable", with the quorum level in the middle.[19]
- MapReduce support
- Cassandra has Hadoop integration, with MapReduce support. There is support also for Apache Pig and Apache Hive.[20]
- Query language
- Cassandra introduced the Cassandra Query Language (CQL). CQL is a simple interface for accessing Cassandra, as an alternative to the traditional Structured Query Language (SQL).
- Eventual consistency
- Cassandra manages eventual consistency of reads, upserts and deletes through Tombstones.
Cassandra Query Language
Cassandra introduced the Cassandra Query Language (CQL). CQL is a simple interface for accessing Cassandra, as an alternative to the traditional Structured Query Language (SQL). CQL adds an abstraction layer that hides implementation details of this structure and provides native syntaxes for collections and other common encodings. Language drivers are available for Java (JDBC), Python (DBAPI2), Node.JS (Datastax), Go (gocql) and C++.[21]
The keyspace in Cassandra is a namespace that defines data replication across nodes. Therefore, replication is defined at the keyspace level. Below an example of keyspace creation, including a column family in CQL 3.0:[22]
CREATE KEYSPACE MyKeySpace
WITH REPLICATION = { 'class' : 'SimpleStrategy', 'replication_factor' : 3 };
USE MyKeySpace;
CREATE COLUMNFAMILY MyColumns (id text, lastName text, firstName text, PRIMARY KEY(id));
INSERT INTO MyColumns (id, lastName, firstName) VALUES ('1', 'Doe', 'John');
SELECT * FROM MyColumns;
Which gives:
id | lastName | firstName
----+----------+----------
1 | Doe | John
(1 rows)
Known issues
Up to Cassandra 1.0, Cassandra was not row level consistent,[23] meaning that inserts and updates into the table that affect the same row that are processed at approximately the same time may affect the non-key columns in inconsistent ways. One update may affect one column while another affects the other, resulting in sets of values within the row that were never specified or intended. Cassandra 1.1 solved this issue by introducing row-level isolation.[24]
Cassandra is not supported on Windows as of version 4, see issue CASSANDRA-16171.[25]
Tombstones
Deletion markers called "Tombstones" are known to cause severe performance degradation.[26]
Data model
Cassandra is wide column store, and, as such, essentially a hybrid between a key-value and a tabular database management system. Its data model is a partitioned row store with tunable consistency.[19] Rows are organized into tables; the first component of a table's primary key is the partition key; within a partition, rows are clustered by the remaining columns of the key.[27] Other columns may be indexed separately from the primary key.[28]
Tables may be created, dropped, and altered at run-time without blocking updates and queries.[29]
Cassandra cannot do joins or subqueries. Rather, Cassandra emphasizes denormalization through features like collections.[30]
A column family (called "table" since CQL 3) resembles a table in an RDBMS (Relational Database Management System). Column families contain rows and columns. Each row is uniquely identified by a row key. Each row has multiple columns, each of which has a name, value, and a timestamp. Unlike a table in an RDBMS, different rows in the same column family do not have to share the same set of columns, and a column may be added to one or multiple rows at any time.[31]
Each key in Cassandra corresponds to a value which is an object. Each key has values as columns, and columns are grouped together into sets called column families. Thus, each key identifies a row of a variable number of elements. These column families could be considered then as tables. A table in Cassandra is a distributed multi dimensional map indexed by a key. Furthermore, applications can specify the sort order of columns within a Super Column or Simple Column family.
Management and monitoring
Cassandra is a Java-based system that can be managed and monitored via Java Management Extensions (JMX). The JMX-compliant nodetool utility, for instance, can be used to manage a Cassandra cluster (adding nodes to a ring, draining nodes, decommissioning nodes, and so on).[32] Nodetool also offers a number of commands to return Cassandra metrics pertaining to disk usage, latency, compaction, garbage collection, and more.[33]
Since Cassandra 2.0.2 in 2013, measures of several metrics are produced via the Dropwizard metrics framework,[34] and may be queried via JMX using tools such as JConsole or passed to external monitoring systems via Dropwizard-compatible reporter plugins.[35]
See also
- Bigtable - Original distributed database by Google
- Distributed database
- Distributed hash table (DHT)
- Dynamo (storage system) - Cassandra borrows many elements from Dynamo
- Scylla - a distributed data store written in C++ that's API-compatible with Cassandra
References
- https://github.com/apache/cassandra/releases/tag/cassandra-4.0.7.
- Casares, Joaquin (2012-11-05). "Multi-datacenter Replication in Cassandra". DataStax. Retrieved 2013-07-25.
Cassandra’s innate datacenter concepts are important as they allow multiple workloads to be run across multiple datacenters…
- "Apache Cassandra Documentation Overview". Retrieved 2021-01-21.
- Hamilton, James (July 12, 2008). "Facebook Releases Cassandra as Open Source". Retrieved 2009-06-04.
- "Is this the new hotness now?". Mail-archive.com. 2009-03-02. Archived from the original on 25 April 2010. Retrieved 2010-03-29.
- "Cassandra is an Apache top level project". Mail-archive.com. 2010-02-18. Archived from the original on 28 March 2010. Retrieved 2010-03-29.
- "The meaning behind the name of Apache Cassandra". Archived from the original on 2016-11-01. Retrieved 2016-07-19.
Apache Cassandra is named after the Greek mythological prophet Cassandra. [...] Because of her beauty Apollo granted her the ability of prophecy. [...] When Cassandra of Troy refused Apollo, he put a curse on her so that all of her and her descendants' predictions would not be believed. [...] Cassandra is the cursed Oracle[.]
- "The Apache Software Foundation Announces Apache Cassandra Release 0.6 : The Apache Software Foundation Blog". Retrieved 5 January 2016.
- "The Apache Software Foundation Announces Apache Cassandra 0.7 : The Apache Software Foundation Blog". Retrieved 5 January 2016.
- Eric Evans. "[Cassandra-user] [RELEASE] 0.8.0". Archived from the original on 8 June 2015. Retrieved 5 January 2016.
- "Cassandra 1.0.0. Is Ready for the Enterprise". InfoQ. Retrieved 5 January 2016.
- "The Apache Software Foundation Announces Apache Cassandra™ v1.1 : The Apache Software Foundation Blog". Retrieved 5 January 2016.
- "The Apache Software Foundation Announces Apache Cassandra™ v1.2 : The Apache Software Foundation Blog". apache.org. Retrieved 11 December 2014.
- Sylvain Lebresne (10 September 2014). "[VOTE SUCCESS] Release Apache Cassandra 2.1.0". mail-archive.com. Retrieved 11 December 2014.
- "Cassandra 2.2, 3.0, and beyond". 16 June 2015. Retrieved 22 April 2016.
- "Cassandra Server Releases". cassandra.apache.org. Retrieved 15 December 2015.
- "Deploying Cassandra across Multiple Data Centers". DataStax. Retrieved 11 December 2014.
- "The CAP Theorem - Learn Cassandra". teddyma.gitbooks.io.
- DataStax (2013-01-15). "About data consistency". Archived from the original on 2013-07-26. Retrieved 2013-07-25.
- "Hadoop Support" Archived 2017-11-16 at the Wayback Machine article on Cassandra's wiki
- "DataStax C/C++ Driver for Apache Cassandra". DataStax. Retrieved 15 December 2014.
- "CQL". Archived from the original on 13 January 2016. Retrieved 5 January 2016.
- "WAT - Cassandra: Row level consistency #$@&%*! - datanerds.io". datanerds.io. Retrieved 28 November 2016.
- Lebresne, Sylvain (2012-02-21). "Coming up in Cassandra 1.1: Row Level Isolation". DataStax: always-on data platform | NoSQL | Apache Cassandra. Retrieved 2018-07-18.
- "How do I build or install Cassandra 4.0 on Windows 10?". Datastax Community. 2021-07-31. Retrieved 2022-04-07.
- Rodriguez, Alain (27 Jul 2016). "About Deletes and Tombstones in Cassandra".
- Ellis, Jonathan (2012-02-15). "Schema in Cassandra 1.1". DataStax. Retrieved 2013-07-25.
- Ellis, Jonathan (2010-12-03). "What's new in Cassandra 0.7: Secondary indexes". DataStax. Retrieved 2013-07-25.
- Ellis, Jonathan (2012-03-02). "The Schema Management Renaissance in Cassandra 1.1". DataStax. Retrieved 2013-07-25.
- Lebresne, Sylvain (2012-08-05). "Coming in 1.2: Collections support in CQL3". DataStax. Retrieved 2013-07-25.
- DataStax. "Apache Cassandra 0.7 Documentation - Column Families". Apache Cassandra 0.7 Documentation. Retrieved 29 October 2012.
- "NodeTool". Cassandra Wiki. Archived from the original on 13 January 2016. Retrieved 5 January 2016.
- "How to monitor Cassandra performance metrics". Datadog. 3 December 2015. Retrieved 5 January 2016.
- "Metrics". Cassandra Wiki. Retrieved 5 January 2016.
- "Monitoring". Cassandra Documentation. Retrieved 1 February 2018.
Bibliography
- Carpenter, Jeff; Hewitt, Eben (July 24, 2016). Cassandra: The Definitive Guide (2nd ed.). O'Reilly Media. p. 370. ISBN 978-1-4919-3366-4.
- Capriolo, Edward (July 15, 2011). Cassandra High Performance Cookbook (1st ed.). Packt Publishing. p. 324. ISBN 978-1-84951-512-2.
- Hewitt, Eben (December 15, 2010). Cassandra: The Definitive Guide (1st ed.). O'Reilly Media. p. 300. ISBN 978-1-4493-9041-9.
External links
- Lakshman, Avinash (2008-08-25). "Cassandra - A structured storage system on a P2P Network". Engineering @ Facebook's Notes. Retrieved 2014-06-17.
- "The Apache Cassandra Project". Forest Hill, MD, USA: The Apache Software Foundation. Retrieved 2014-06-17.
- "Project Wiki". Forest Hill, MD, USA: The Apache Software Foundation. Archived from the original on 2014-06-14. Retrieved 2014-06-17.
- Hewitt, Eben (2010-12-01). "Adopting Apache Cassandra". infoq.com. InfoQ, C4Media Inc. Retrieved 2014-06-17.
- Lakshman, Avinash; Malik, Prashant (2009-08-15). "Cassandra - A Decentralized Structured Storage System" (PDF). cs.cornell.edu. The authors are from Facebook. Retrieved 2014-06-17.
- Ellis, Jonathan (2009-07-29). "What Every Developer Should Know About Database Scalability". slideshare.net. Retrieved 2014-06-17. From the OSCON 2009 talk on RDBMS vs. Dynamo, Bigtable, and Cassandra.
- "Cassandra-RPM - Red Hat Package Manager (RPM) build for the Apache Cassandra project". code.google.com. Menlo Park, CA, USA: Google Project Hosting. Retrieved 2014-06-17.
- Roth, Gregor (2012-10-14). "Cassandra by example - the path of read and write requests". slideshare.net. Retrieved 2014-06-17.
- Mansoor, Umer (2012-11-04). "A collection of Cassandra tutorials". Retrieved 2015-02-08.
- Bushik, Sergey (2012-10-22). "A vendor-independent comparison of NoSQL databases: Cassandra, HBase, MongoDB, Riak". NetworkWorld. Framingham, MA, USA and Staines, Middlesex, UK: IDG. Archived from the original on 2014-05-28. Retrieved 2014-06-17.