| title | Apache Wayang — Hackathon at Community over Code Glasgow 2026 |
|---|
Community over Code 2026 — Glasgow, UK, October 11–14
Register now | Event website | Hackathon overview
Apache Wayang — Hackathon
Coordinator
- Zoi Kaoudi (PMC, Apache Wayang) — zkaoudi@apache.org
What We Are Working On
Apache Wayang is a cross-platform data processing framework that recently graduated to ASF Top-Level Project status. At the hackathon we will be mainly focusing on small extensions on the operators Wayang provides. Specifically:
- Join Operators — implement additional join algorithms (starting with merge join) for the Java-platform join operator (Java execution operator). Good for someone comfortable with Java and core algorithms.
- Limit Operator — create a new
LimitOperatorthat returns the first N elements of a dataset. A great entry point for newcomers: conceptually simple, and a good way to learn Wayang’s operator structure end-to-end. This requires adding a new Wayang operator and at least one execution operator on a platform the participant is more confident with. - Data Lake Pipeline — build a pipeline that computes total revenue per nation, joining data across two storage layers:
lineitemandordersread as Parquet files (via Wayang’sreadParquetAPI), joined withcustomerandnationread as Postgres tables, then aggregated (filter by date, join across all four, compute revenue, group by nation, sort, limit to top N). Register at least two platforms (e.g. Java/Spark + Postgres) so the optimizer has a real choice — seeQuery3Hybrid.scalainwayang-benchmarkas a starting template. Good for someone who wants to play with Wayang’s API and build a concrete, TPC-H-adjacent task showing cross-source, cross-platform execution. - Documentation improvements — walk through the getting-started guide as a newcomer and fix the points where you get stuck.
Resources
- Getting started
- Adding operators in Wayang
- Developing in Wayang
- Wayang Javadocs
- Contribution guide
- GitHub issues
- Slack channel
- Dev environment setup with docker: Coming up!
Who’s Planning to Attend
- Zoi Kaoudi (PMC, Apache Wayang)
Getting Started Before the Event
To make the most of hackathon time, we recommend:
- Clone the repo, get the build working, and run the WordCount.
- Browse the issue list and pick a task — Hackathon tasks listed above will be pre-tagged for the event
- Introduce yourself on the dev@wayang list or Slack channel before the event
- Back to the Hackathon overview
- Questions? Join #hackathon on apachecon.slack.com