Apache Avro

Apache Avro
Developer(s)Apache Software Foundation
Initial release2 November 2009 (2009-11-02)[1]
Stable release
1.11.3 / September 23, 2023 (2023-09-23)[2]
RepositoryAvro Repository
Written inJava, C, C++, C#, Perl, Python, PHP, Ruby
TypeRemote procedure call framework
LicenseApache License 2.0
Websiteavro.apache.org

Avro is a row-oriented remote procedure call and data serialization framework developed within Apache's Hadoop project. It uses JSON for defining data types and protocols, and serializes data in a compact binary format. Its primary use is in Apache Hadoop, where it can provide both a serialization format for persistent data, and a wire format for communication between Hadoop nodes, and from client programs to the Hadoop services. Avro uses a schema to structure the data that is being encoded. It has two different types of schema languages: one for human editing (Avro IDL) and another which is more machine-readable based on JSON.[3]

It is similar to Thrift and Protocol Buffers, but does not require running a code-generation program when a schema changes (unless desired for statically-typed languages).

Apache Spark SQL can access Avro as a data source.[4]

  1. ^ "Apache Avro: a New Format for Data Interchange". blog.cloudera.com. Retrieved March 10, 2019.
  2. ^ "Apache Avro Releases". avro.apache.org. Retrieved September 23, 2023.
  3. ^ Kleppmann, Martin (2017). Designing Data-Intensive Applications (First ed.). O'Reilly. p. 122.
  4. ^ "3 Reasons Why In-Hadoop Analytics are a Big Deal - Dataconomy". dataconomy.com. April 21, 2016.

© MMXXIII Rich X Search. We shall prevail. All rights reserved. Rich X Search