Skip to main content

Apache Incubator Welcomes DevLake, A Dev-Data Platform Serving Developers

· 2 min read
Maxim Wheatley

We are excited to share today that the Apache Software Foundation (ASF) voted to make DevLake an officially supported project of the Apache Incubator.

What is DevLake?

Launched in December of 2021, Apache DevLake is an open-source dev data platform that ingests, analyzes, and visualizes the fragmented data in developer tools.

Software development is complex, requiring many tools and processes, and as a result creates a storm of data scattered across tools in many formats. This makes it difficult to organize, query, and make sense of. We built Apache DevLake, to make it easy to make sense of this rich data and to translate it into actionable insights.

Apache DevLake's key features:

  • DevOps data collection across software development lifecycle (SDLC) to connect data islands
  • Standardized data models with out-of-the-box metrics and customizable dashboards
  • Flexible plugin system for user-defined data integration and transformation

Below is the architecture of Apache DevLake: architecture

Why join Apache Incubator?

First and foremost, we firmly believe in Apache's principle of "Community over Code" and "The Apache Way". We look forward to building a vibrant, inclusive, and diverse community under the guidance of our mentors through the incubator journey.

We also feel that the Apache community has one of the strongest ecosystems when it comes to data-oriented open-source projects.

Last and not least, the support and enthusiasm of the Apache community and mentors made it clear to us that this would be a place where we can truly evolve and nurture Apache DevLake.

In the months leading up to DevLake's acceptance, our mentors provided guidance and suggestions instrumental to making this important moment a reality. We want to take this opportunity to thank and acknowledge them:

  • Willem Ning Jiang: Apache DevLake Champion; ASF Member & Board Director

  • Liang Zhang: Founder & CEO of SphereEx; ASF Member, Founder & PMC Chair of Apache ShardingSphere

  • Lidong Dai: ASF Member; Apache DolphinScheduler PMC Chair

  • Sijie Guo: ASF Member, PMC member of Apache Pulsar; Founder & CEO of StreamNative

  • Felix Cheung: ASF Member, PMC on Spark, Superset, Yunikorn, Zeppelin, Pinot, and Incubator. SVP of Engineering at SafeGraph.

  • Jean-Baptiste Onofré: ASF Member, Karaf PMC Chair, PMC on ActiveMQ, Archiva, Aries, Beam, Brooklyn, Camel, Carbondata, Felix, Incubator, and many more.

Apache DevLake Future Roadmap

  • Enhance system scalability and performance in large-scale data scenarios.
  • Integrate more data sources and tools (JIRA, GitHub, GitLab, and Jenkins are already supported.)
  • Enable support for OLAP databases, providing users with more choices.
  • Provide more scenario-specific, out-of-the-box dashboards and templates reflecting best practices and well-known methodologies to improve usability.

Join us!

We invite developers and those passionate about data-driven engineering to 'dive into the lake' with us, and welcome contributions of all kinds. Join us on Slack and at our weekly open source community meetups🥳

Apache DevLake (Incubating) Links: