• Comment: Not clear whether these publications are independent. Also unclear on the relationship to 'Rheem' Stuartyeates (talk) 19:28, 8 September 2023 (UTC)
  • Comment: The title of this draft either has been disambiguated or will require disambiguation if accepted.
    If this draft is accepted, a hatnote will need to be added to the primary page to refer to this page. If there is already a hatnote on the primary page, please review whether a disambiguation page is in order instead.
    The primary page is Wayang. Robert McClenon (talk) 17:18, 26 July 2023 (UTC)

Apache Wayang (incubating)
Stable release
0.6
Repositoryhttps://github.com/apache/incubator-wayang
Written inJava
PlatformCross-platform
LicenseApache License 2.0
Websitewayang.apache.org

Apache Wayang is an open-source cross-platform data processing system for unified data analytics[1]. Wayang provides a meta-processing framework that allows users to develop and run analytics seamlessly on multiple data processing engines such as Apache Spark, Apache Flink, Java Streams, and PostgreSQL. Originally started as the Rheem project[2] at the Qatar Computing Research Institute (QCRI), the codebase was later renamed to Wayang and was donated to the Apache Software Foundation, where the project is under incubation.

Architecture edit

Wayang has a three-layer architecture:

  1. The application layer models all application-specific logic
  2. The core layer provides the intermediate representation between applications and processing platforms
  3. The platform layer connects and executes the underlying processing platform tasks

Features edit

Wayang supports the following data processing platforms:

See also edit

References edit

  1. ^ Beedkar, Kaustubh; Contreras-Rojas, Bertty; Gavriilidis, Haralampos; Kaoudi, Zoi; Markl, Volker; Pardo-Meza, Rodrigo; Quiané-Ruiz, Jorge-Arnulfo (2023-11-02). "Apache Wayang: A Unified Data Analytics Framework". ACM SIGMOD Record. 52 (3): 30–35. doi:10.1145/3631504.3631510. ISSN 0163-5808. S2CID 260235507.
  2. ^ Agrawal, Divy; Chawla, Sanjay; Contreras-Rojas, Bertty; Elmagarmid, Ahmed; Idris, Yasser; Kaoudi, Zoi; Kruse, Sebastian; Lucas, Ji; Mansour, Essam; Ouzzani, Mourad; Papotti, Paolo; Quiané-Ruiz, Jorge-Arnulfo; Tang, Nan; Thirumuruganathan, Saravanan; Troudi, Anis (2018-07-01). "RHEEM: enabling cross-platform data processing: may the big data be with you!". Proceedings of the VLDB Endowment. 11 (11): 1414–1427. doi:10.14778/3236187.3236195. ISSN 2150-8097. S2CID 51994386.