Airbyte @AirbyteHQ Twitter profile

Pinned Tweet

Airbyte

@AirbyteHQ

2 months

Winter Release 2024, coming in hot! ❄️ 🔥 🐍 PyAirbyte - Use Airbyte connectors from the comfort of your Python envs

1

2

11

Last Seen Profiles

@QueseriaCortas

@NunewBrasil

@nmacheaux

@PenrithACT

@whales_org

@Padillac_16

@ei_pipo

@faestorian

@gimmedatjayy

@did_bastille

@coffejn

@noire172

@KWojehowskiPBL

@JerryBriggs

@BenedictoLozano

@Minjursaleem

@katokrew

@rwra026

@letroblesrosa

@sush1cart

@colliholly

@ordinarywillard

@notdevussy

@residuscat

@rscook

@TomKeiferMusic

@PaulHBeckwith

@rivercitycasino

@HeidiAtter

@FSCMalhamTarn

@LiquidDeath

@jamaica_classic

@cchilab

@gcPula

@comp_hx_soc

@NATAIOBOT

Airbyte

@AirbyteHQ

2 years

RT if you believe basic SQL is here to stay like we do

8

77

286

Airbyte

@AirbyteHQ

2 years

We’re super excited to announce that we just raised $150 million funding in Series B ($1.5B valuation) led by Altimeter and Coatue. This brings us closer to our goal: power all companies’ data movement. #moderndatastack #funding #opensource [1/12]

$150M Series-B Boost: Powering Data Movement | Airbyte

$150M Boost - Learn how substantial Series-B funding is driving data movement and innovation.

airbyte.com

3

29

168

Airbyte

@AirbyteHQ

1 year

What are the best Data Engineering newsletters? Presenting the State of Data Engineering survey results, ahead of our Move(data) Conference next week! Winners: @SeattleDataGuy , @bennstancil , @prukalpa , @itunpredictable , @madisonmaeorg

2

13

70

Airbyte

@AirbyteHQ

6 months

We at Airbyte are excited to share our journey of optimizing our CI/CD process with the Dagger platform. As an open-source ELT platform managing hundreds of Docker containers, we faced challenges with our original CI system, which was a maze of GitHub Actions, YAML, and shell…

5

13

59

Airbyte

@AirbyteHQ

2 years

Most surprising result so far from our State of Data Engineering Survey (): 🛑 20% of data teams are in a hiring freeze! 🛑 We're conducting the biggest survey of Data Engineers ever. BigQuery vs Snowflake? Monte Carlo vs Great Expectations? Come vote!

3

5

60

Airbyte

@AirbyteHQ

1 year

move(data) 2022 is going to be the biggest Data Engineering conference yet! You don't wanna miss anything 😉 Join us using the link below to secure your ticket now!

3

7

54

Airbyte

@AirbyteHQ

4 years

Help us prioritize which connectors to build first with this 1.55 min long survey (that's our average)! Only 4 questions that will help us prioritize the connectors YOU need, so please participate!

4

11

55

Airbyte

@AirbyteHQ

2 years

🐙+🦘=❤️ Airbyte acquires Grouparoo to accelerate Data Movement

Airbyte Acquires Grouparoo: Expanding Capabilities | Airbyte

Airbyte Acquires Grouparoo - Learn about the expansion with the acquisition of the reverse-ETL open-source product.

airbyte.com

3

15

54

Airbyte

@AirbyteHQ

1 year

🥳🚀 We've reached a massive milestone! 10k stars on GitHub, and we couldn't have done it without our incredible community! 🌟 Your passion, support, and contributions are the true driving force behind our success. Thank YOU for being on this journey with us! 🙌

3

8

45

Airbyte

@AirbyteHQ

5 years

There is so much knowledge to gain from top engineering leaders, that we decided to curate their best articles and list all the key insights for you in our new blog. Our newsletter "Weekly Bytes" curates the top 5 new articles right in your mailbox.

1

42

Airbyte

@AirbyteHQ

6 years

While software engineering efficiency has become key to every company, it is still a black box and is mostly managed in a gut-driven way. That's the problem @anaxihq addresses by bringing visibility to the software development process.

Anaxi brings more visibility to the development process | TechCrunch

Anaxi's mission is to bring more transparency to the software development process. The tool, which is now live for iOS, with web and Android versions

techcrunch.com

1

4

35

Airbyte

@AirbyteHQ

2 months

Airbyte x 🐍 Coming soon..

5

7

35

Airbyte

@AirbyteHQ

2 years

How do you build a user-facing dashboard without impacting your production database? Here is how @dunithd did it using Airbyte, @apachekafka , and @ApachePinot .

2

14

36

Airbyte

@AirbyteHQ

2 years

🤖 Data Nets: The Rise of the AI-first Data Stack Missed out on the furious debate at @coalesceconf this year? We ETLDR'ed your favorite data elite to explain why @pdrmnvd , @tayloramurphy , @imightbemary , @teej_m can't stop talking about Data Nets!

Data Nets: The Rise of the AI-first Data Stack | Airbyte

The implication of a fully AI-first Data Net architecture is that data engineering as we know it today will cease to exist. Data engineers will be replaced by AI-powered data pipelines that are able...

airbyte.com

7

5

33

Airbyte

@AirbyteHQ

3 years

In March, we announced our $5.2M Seed round with Accel. Today, we're announcing our $26M Series A with Benchmark! So much happened in the past 2 months. Metrics quadrupled: companies syncing data (500 to 2,000), Slack community (with now 1,300 members), contributors too! [1/2]

4

6

32

Airbyte

@AirbyteHQ

9 months

⏰ NEW TUTORIAL ⏰ Learn how to chat with our SQL data warehouse using @llama_index - Write questions in plain English - Have AI write SQL queries to answer the questions - No need for embeddings or vectorstore databases. Check it out now 👇

Airbyte and LlamaIndex: ELT and Chat with your data warehouse without writing SQL | Airbyte

Learn how to chat with your data warehouse using Airbyte and LlamaIndex. Discover the power of querying databases with natural language, bypassing the need for SQL expertise and memorization of...

airbyte.com

0

6

31

Airbyte

@AirbyteHQ

3 years

Here's a great big guide on data engineering! 👉 The Data Engineering Cookbook The repo got almost 10k stars on Github, it's well written and contains all information you need to know to start you #dataengineering journey! #bigdata #dataops

GitHub - andkret/Cookbook: The Data Engineering Cookbook

The Data Engineering Cookbook. Contribute to andkret/Cookbook development by creating an account on GitHub.

github.com

0

8

24

Airbyte

@AirbyteHQ

10 months

⏰ NEW TUTORIAL ⏰ Learn how to chat with our SQL data warehouse using @llama_index - Write questions in plain English - Have AI write SQL queries to answer the questions - No need for embeddings or vectorstore databases. Check it out now 👇

0

11

26

Airbyte

@AirbyteHQ

6 years

Who never experienced this?! :sweat_smile:

1

15

25

Airbyte

@AirbyteHQ

3 years

Today, we are announcing an important change about Airbyte and how we are going to future proof the commoditization of data integration with the Airbyte community. (1/7)

Future-Proof Data Integration: New Licensing | Airbyte

Future-Proofing Data Integration - Explore a new license to secure the future of data commoditization.

airbyte.com

1

7

25

Airbyte

@AirbyteHQ

2 years

Airbyte is now integrating with Prefect 👇!!

Prefect

@PrefectIO

2 years

Verified by Twitter? So 2008. Verified by Prefect is the new blue check. Today launches our new Premier Technology Partner Program within our partner ecosystem, read on 👉

1

7

43

0

2

23

Airbyte

@AirbyteHQ

1 year

Someone in Slack made a Data Engineer Playlist in Spotify😂

0

4

23

Airbyte

@AirbyteHQ

11 months

🎉 We have officially launched our new Connector Builder! Creating REST API Connectors has never been easier and did we mention it can now be done with no code? Here are some resources for you to get started 🧵⬇️

1

11

23

Airbyte

@AirbyteHQ

2 years

🏆 Here are our picks of the best database/warehouse podcasts! - Data Brew by @databricks - Data Cloud by @SnowflakeDB - @MongoDB pod by @mlynn - Open||Source||Data by @DataStax 's @sramji - @Confluent Streaming Audio with @krisajenkins 💙

Best Data Podcasts in 2022: Airbyte Staff Picks | Airbyte

Best Data Podcasts in 2022 - Airbyte Staff Picks for staying informed and entertained.

airbyte.com

3

9

21

Airbyte

@AirbyteHQ

2 years

Postgres has established itself as one of the most popular databases in the 🌎. Our team spent the last quarter developing our Postgres GA Connector for Airbyte Cloud, which is now live! 🥳 New accounts will receive 30 days of unlimited syncs below.

Adding to our catalog of high-performing, reliable database connectors, Postgres is now in general...

Adding to our catalog of high-performing, reliable database connectors, Postgres is now in general availability, including full syncs, incremental syncs and CDC.

airbyte.com

2

12

21

Airbyte

@AirbyteHQ

1 year

wow - Airbyte is on the HN front page today! Thanks for your support!

0

21

Airbyte

@AirbyteHQ

3 years

We're on @TechCrunch today for our Series-A announcement, led by @benchmark , @Accel , and @ycombinator ! We are also honored to count @kimchy and @dittycheria among other as investors! Onward to changing how data is being moved!

Airbyte announces $26M Series A for open-source data connector platform | TechCrunch

One of the major issues facing companies these days isn't finding relevant data so much as moving it to where it's needed. Enter Airbyte, an early-stage

techcrunch.com

2

4

21

Airbyte

@AirbyteHQ

1 year

|￣￣￣￣￣￣￣￣￣￣￣￣￣￣| Stop writing custom ELT scripts |＿＿＿＿＿＿＿＿＿＿＿＿＿＿| \ (•◡•) / \ / —— | | |_ |_

0

2

21

Airbyte

@AirbyteHQ

2 years

How it started How it's going

Sudhee Chilappagari

@webaficionado

3 years

@AirbyteHQ has nailed community-led growth by leveraging Slack and focusing on two key metrics: time to first response & time to resolution. Result: their GitHub repo stars chart is not a curve, it's a straight line 🤯

1

5

18

0

6

19

Airbyte

@AirbyteHQ

11 months

In the past few months, we surveyed the data community in order to build the State of Data 2023. With 886 participants, this is the largest data engineering survey! 1/8

1

6

19

Airbyte

@AirbyteHQ

1 year

Apache Airflow simplified in under 60 seconds

0

2

19

Airbyte

@AirbyteHQ

5 years

Debugging front-end ;)

0

6

18

Airbyte

@AirbyteHQ

1 year

In this article, we discuss the fundamental architectural difference that makes data warehouses appropriate for analytics, and that makes operational databases appropriate for operational workloads.

Data Warehouse vs. Operational Database! What? How? Which One? | Airbyte

Learn about the fundamental difference between a data warehouse and an operational database!

airbyte.com

0

2

19

Airbyte

@AirbyteHQ

2 years

🏆 Here are the best *NEW* data podcasts in 2022! - The Right Track by @StefaniaBje @avohq - @preset_data 's Analytics Everywhere by @mistercrunch - Data Tea by @HightouchData @MaryMacCarthy - @mehd_io 's Data Creators Club - @iCanAutomate 's @databeatsnow

Best Data Podcasts in 2022: Airbyte Staff Picks | Airbyte

Best Data Podcasts in 2022 - Airbyte Staff Picks for staying informed and entertained.

airbyte.com

2

5

19

Airbyte

@AirbyteHQ

2 years

Our latest blog post discusses the evolution of the #dataengineering role! ✨ This blog post looks at the past and the present of the data engineer role, examining emerging #trends to offer you some predictions about the future 🔮

The Evolution of The Data Engineer: A Look at The Past, Present & Future | Airbyte

The Evolution of The Data Engineer: A Look at The Past, Present & Future

airbyte.com

0

3

19

Airbyte

@AirbyteHQ

9 months

Learn everything you'll need to implement robust AI data pipelines with @LangChainAI and @dagster Use Dagster to set up a pipeline that processes the data and stores it in a vector Combine information in the store with LLMs using the LangChain QA module

How to implement AI data pipeline?: Langchain, Dagster & Airbyte | Airbyte

Let's implement AI data pipelines seamlessly with Langchain, Airbyte, and Dagster. Explore step-by-step guidance here.

airbyte.com

1

3

19

Airbyte

@AirbyteHQ

2 years

Tuesday was a big day for @dagsterio at the #dagsterday ! We wrote a short recap about the announcements and newest features ✨. Huge congrats on the v1.0 release and the General Availability of Dagster Cloud! 👏🏻 #branchdeployments .

Dagster 1.0 and Dagster Cloud Launch Recap | Airbyte

Dagster 1.0 and Dagster Cloud Launch Recap - A recap of the launch of Dagster 1.0 and Dagster Cloud.

airbyte.com

0

4

18

Airbyte

@AirbyteHQ

5 years

Genius or stupid?

0

2

18

Airbyte

@AirbyteHQ

2 years

An Airbyte user self-hosting an unsecured instance had their connector credentials stolen. Transparency is a core value at Airbyte. Here's what happened, what you should know, and what we will do to improve.

Improving Security for Open Source Airbyte Users | Airbyte

An Airbyte user self-hosting an unsecured instance had their connector credentials stolen. Here's what you should know, and what Airbyte is doing.

airbyte.com

1

4

18

Airbyte

@AirbyteHQ

8 months

We're excited to announce Destinations V2! It ships with: - One-to-one table mapping - Improved per-row error handling with _airbyte_meta - Internal Airbyte tables in the airbyte_internal schema - Incremental delivery for large syncs

Introducing Airbyte Destinations V2 - Typing & Deduping | Airbyte

Explore Airbyte Destinations V2 with typing and deduplication features. Enhance data accuracy and efficiency.

airbyte.com

0

5

18

Airbyte

@AirbyteHQ

2 years

At Airbyte we use @temporalio to orchestrate data sync jobs. Benoit Moriceau shared how we use the Java SDK and organize Temporal workflows.

How we scale workflow orchestration with Temporal | Airbyte

Learn how we use Temporal to orchestrate workflows to synchronize data between sources and destinations. Temporal enables Airbyte to programmatically configure workflows with the Java SDK.

airbyte.com

1

6

18

Airbyte

@AirbyteHQ

2 years

TIL Airbyte is the #10 open source modern data stack project according to @OSSInsight - thanks for 🌟 ing us!

0

2

18

Airbyte

@AirbyteHQ

1 year

🎂 It's the 10 year anniversary of #AmazonRedshift today! What do you think were the key highlights of AWS' fastest growing service? How did it revolutionize the industry, and where is it going in the next decade? Full retro + 2 insider interviews:

Redshift Turns 10: Evolution of Cloud Data Warehouse | Airbyte

Redshift's 10-Year Evolution - Tracing the remarkable journey of Amazon’s Cloud Data Warehouse.

airbyte.com

1

6

17

Airbyte

@AirbyteHQ

1 year

The Airbyte API is now Generally Available 🥳 Check out the video below for a quick step-by-step guide on how to use it ⬇️

1

17

Airbyte

@AirbyteHQ

5 years

All freelancers will understand!

1

16

Airbyte

@AirbyteHQ

1 year

12 Things You Should Know If You Want To Become A Data Engineer In 2023 (Day 1)

1

2

17

Airbyte

@AirbyteHQ

2 years

Data pipelines in a nutshell 😎

0

3

15

Airbyte

@AirbyteHQ

1 year

Bay area friends! @DataCouncilAI SF is hosting a meetup @census Thur Feb 2. Talks: ⭐ Asha Hill, Sr. Data Scientist @ModeAnalytics 🌟 Jason Pohl, Principal Solutions Architect @databricks about @DeltaLakeOSS & @duckdb Food, drinks and good times on us!

1

6

16

Airbyte

@AirbyteHQ

2 years

Last week, we got 3/4 of the team in San Francisco. It was amazing to see them in real life. Nothing replaces spending time together in person. We're so looking forward to our next in-person event!! #remote

0

16

Airbyte

@AirbyteHQ

1 year

Shakespeare explains the Modern Data Stack

1

15

Airbyte

@AirbyteHQ

1 year

Thousands of attendees are already streaming in for Day 1 of move(data) conf! Join us: and all these amazing speakers!

1

5

15

Airbyte

@AirbyteHQ

9 months

Have you heard of @LangChainAI ? If you haven't, you're about to learn 🧠 We now support vector databases (Pinecone and DocArray) through LangChain! Learn more in our article below

Airbyte Now Supports Vector Databases: LangChain Powered | Airbyte

Airbyte and Vector Databases - Empowering data integration with support for Vector Databases powered by LangChain.

airbyte.com

1

5

13

Airbyte

@AirbyteHQ

2 years

Check out @RealChrisSean as he shows us how you can load your data from @googlesheets to @PostgreSQL in AWS RDS all in 18 minutes!

Load Your Data from Google Sheets to PostgreSQL in AWS RDS in 18...

Do you have data in Google Sheets that you need to migrate to PostgreSQL?This video will take you through the steps needed to set up Airbyte Cloud and copy o...

www.youtube.com

0

3

15

Airbyte

@AirbyteHQ

10 months

Dive into our EaC for data structure tutorial and learn how to: - Use Airbyte’s Terraform provider to manage data ingestion - Orchestrate multiple Airbyte syncs in parallel using Kestra - Add data transformations with dbt and Python - And more!

Everything as Code for Data Infrastructure with Airbyte and Kestra Terraform Providers | Airbyte

Learn how to implement Everything as Code (EaC) with the Airbyte and Kestra Terraform providers

airbyte.com

0

9

15

Airbyte

@AirbyteHQ

1 year

Simplifying Docker in under 60 seconds

0

15

Airbyte

@AirbyteHQ

2 years

Wanna learn how to become a Data Engineer for FREE? Here are 3 free resources to help you do just that! 😉

0

4

15

Airbyte

@AirbyteHQ

5 years

To a project finished at last!

0

2

15

Airbyte

@AirbyteHQ

5 years

How I see recruiters

0

2

14

Airbyte

@AirbyteHQ

5 years

Coders just want to have fun...

0

3

14

Airbyte

@AirbyteHQ

1 year

🐘 Meet the hottest new Data community: Mastodon! Your guide to a federated social media future, and how to join the burgeoning new Data Folks on the platform that *cannot be bought*!

The Data Engineer's Guide to Mastodon | Airbyte

Are you a data engineer looking to make the switch from Twitter to Mastodon? In this blog post, we provide tips and guides for data engineers transitioning to Mastodon, including how to set up an...

airbyte.com

2

15

Airbyte

@AirbyteHQ

5 years

Definitely not lazy!

0

6

15

Airbyte

@AirbyteHQ

8 months

It’s now possible to utilize the Airbyte sources for Gong, Hubspot, Salesforce, Shopify, Stripe, Typeform and Zendesk Support directly within your @llama_index based application, implemented as data loaders Learn about using this powerful new tool 👇

Introducing Airbyte Sources Within LlamaIndex | Airbyte

It’s now possible to utilize the Airbyte sources directly within your LlamaIndex-based application, implemented as data loaders.

airbyte.com

1

4

15

Airbyte

@AirbyteHQ

5 years

Coder N°1 rule

0

3

15

Airbyte

@AirbyteHQ

3 years

Our 1st article on @TDataScience ! We talk about ELT as the heir to ETL, but we think EL(T) is coming next. We see @getdbt , @ApacheAirflow with @Astronomerio , @preset_Data , and @expectgreatdata , alongside @AirbyteHQ in the data infrastructure of the future!

0

3

15

Airbyte

@AirbyteHQ

3 years

Today is a very special day: Airbyte is officially turning 1! 🎉 We're going over all what happened in the past year in this article. We also hit a very important milestone as we now officially support 100+ connectors! Thanks so much for your support! 🙏

Airbyte Is Turning 1: Celebrating Open-Source | Airbyte

Airbyte's First Anniversary - Reflecting on a year of open-source data integration innovation.

airbyte.com

0

2

14

Airbyte

@AirbyteHQ

5 years

Coding with a hangover

1

0

14

Airbyte

@AirbyteHQ

3 years

Another week, another release! - New sources: @CockroachDB , @PayPal , @Square , @SurveyMonkey - Improved sources: @GitHub , @GitLab , @Twilio , @Instagram , @Shopify , PostgreSQL, @Okta ✨ S3 destination: supports anyOf, oneOf and allOf schema fields 🏗️ Python CDK update #opensource

1

14

Airbyte

@AirbyteHQ

5 years

End of project review

0

3

14

Airbyte

@AirbyteHQ

1 year

🚀 We now have AI-powered search in our docs Find the answers to your questions with the proper sources even faster! Check it out:

0

3

14

Airbyte

@AirbyteHQ

2 years

Why do data engineers replicate data?

10

4

14

Airbyte

@AirbyteHQ

5 years

When the front-end dev is on vacation

0

3

13

Airbyte

@AirbyteHQ

2 years

🎉 We just hit 10k members on Slack!! 🎉 From all of us here at Airbyte, we can’t thank you enough for the continued support and growth. Here’s to many more and keep on spreadin the word 🗣 ☺️

9

4

13

Airbyte

@AirbyteHQ

1 year

Do you prefer interacting with a web app UI or editing YAML files? Know that Airbyte supports both.

Version control Airbyte configurations with Octavia CLI | Airbyte

Use Octavia CLI to import, edit, and apply Airbyte application configurations.

airbyte.com

2

13

Airbyte

@AirbyteHQ

2 years

Data analysts 80's rock 🤝 We built this CTE

0

1

13

Airbyte

@AirbyteHQ

5 years

What’s going on with all these divs?

0

3

13

Airbyte

@AirbyteHQ

5 years

The first deployment...! #developerjoke

0

3

13

Airbyte

@AirbyteHQ

2 years

We're proud to announce our inaugural Data Podcast awards: 🏆 The Best Data Podcasts in 2022! (Basically we listened to a ton of podcasts and chose our top 5 favorites each, and why you should check them out!) Did we miss any? What are your faves?

Best Data Podcasts in 2022: Airbyte Staff Picks | Airbyte

Best Data Podcasts in 2022 - Airbyte Staff Picks for staying informed and entertained.

airbyte.com

1

2

13

Airbyte

@AirbyteHQ

9 months

AI Is super cool, and here at Airbyte, we think a lot about how engineers can best leverage up-and-coming AI tools. But we're seeing some worrying patterns! There are plenty of data-movement best practices to apply here. No need to reinvent the wheel.

Why AI shouldn’t reinvent ETL | Airbyte

Learn about the challenges of data movement for AI applications, the need for extraction and loading pipelines, and the benefits of using existing solutions. Find out how AI engineers can save time...

airbyte.com

2

5

13

Airbyte

@AirbyteHQ

1 year

"What is DuckDB?" - top data twitter question the past week/month year 🔥 good thing @sspaeti added it to our data glossary recently! It's open source, additions/contributions welcome!

b bennett | 500+ connections

@thebmbennett

1 year

im sorry data twitter i must have missed something—what is DuckDB?

12

3

74

0

3

13

Airbyte

@AirbyteHQ

2 years

Airbyte got its first case study. Exciting! Most of the numbers are outdated now, but it's a pretty great review of everything that happened in the first 9 months of the project! Thanks for doing this @Threado ! #OpenSource

0

5

11

Airbyte

@AirbyteHQ

2 years

We're ecstatic to be named one of @ycombinator 's Top Companies in 2022!!! 🙌🥳🚀

1

2

13

Airbyte

@AirbyteHQ

2 years

In this tutorial, you can build an ELT pipeline to discover GitHub users that have interacted with the Prefect, Airbyte, and dbt repositories by leveraging the three tools! 🤩

Orchestrate ELT pipelines with Prefect, Airbyte and dbt | Airbyte

Learn how to build an ELT pipeline to discover GitHub users that have contributed to the Prefect, Airbyte, and dbt Github repositories by leveraging the three tools.

airbyte.com

0

1

13

Airbyte

@AirbyteHQ

3 years

Have you used #Airflow operators for ETL pipelines? There are huge challenges using its transfer + transformation operators. You'll end up with 100s of connections. The best way is to use Airflow as orchestrator, Airbyte as EL, and dbt as T. #opensource

0

1

12

Airbyte

@AirbyteHQ

2 years

OPEN SOURCE

1

13

Airbyte

@AirbyteHQ

5 years

When your colleagues are stuck on a something simple!

0

2

12

Airbyte

@AirbyteHQ

5 years

The war on interruptions

0

2

12

Airbyte

@AirbyteHQ

1 year

Day 6 of 12 things you need to know if you wanna become a Data Engineer in 2023!

2

1

12

Airbyte

@AirbyteHQ

2 years

And today we dropped our roadmap! What do y'all think? 😄🤨😖

0

3

12

Airbyte

@AirbyteHQ

2 years

At Airbyte, we use Gradle as our build tool, jOOQ as the ORM, and Flyway to manage database migrations for our open-source project. @LirenTu shared why we write Flyway migrations scripts in Java and how we update the jOOQ code with Gradle. @JavaOOQ

How we run database migrations with Flyway, jOOQ, and testcontainers | Airbyte

Learn how to run database migrations with Flyway, jOOQ, and testcontainers. We use Flyway migration scripts in Java, run migrations locally with testcontainers and extend Flyway migrations.

airbyte.com

0

5

12

Airbyte

@AirbyteHQ

1 year

TIL about A vendor neutral directory of connectors! Let us know if you see something you want from us ()

0

1

12

Airbyte

@AirbyteHQ

1 year

Part 2 of "Data Modeling – The Unsung Hero of Data Engineering" is here. We're focusing on modeling approaches & techniques, including top-down vs bottom-up, dimensional, data vault, and entity-centric methods. Learn more about common modeling challenges👇

Data Modeling – The Unsung Hero of Data Engineering: Modeling Approaches and Techniques (Part 2) |...

Exploring approaches, dimensional modeling, and more. Learning how to navigate data modeling complexities and design effective systems for your organization.

airbyte.com

0

12

Airbyte

@AirbyteHQ

2 years

Hex? Preset? Mode? Tableau? Have opinions about BI? Come fill out our STATE OF DATA ENGINEERING survey And weigh in on: - best data substack - best data youtube - best data podcast - best data community Be the first to get results + special🐙 swag!

4

1

12

Airbyte

@AirbyteHQ

2 years

Dagster can orchestrate data ingestion pipelines with Airbyte, SQL-based transformations with dbt, and any kind of Python transformation. Learn how to ingest and transform Github and Slack data into Postgres.

Orchestrate data ingestion and transformation pipelines with Dagster | Airbyte

Learn how to ingest and transform Github and Slack data into Postgres. Dagster can orchestrate data ingestion pipelines with Airbyte, SQL-based transformations with dbt, and any kind of Python...

airbyte.com

1

12

Airbyte

@AirbyteHQ

2 years

We're big fans of Seattle Data Guy, and having an article from him about Airbyte is always a good sign that we must be doing something right! Here's his latest piece: #opensource #bigdata #dataops #dataengineering

Airbyte - Is Open Source The Way Forward For Data Automation?

And The Challenges Of Being A Data Engineer - Community Update #23

seattledataguy.substack.com

0

1

12

Airbyte

@AirbyteHQ

2 years

PSA: Special guest for our next Airbyte Community Call: @vinodhinisd from @lakeFS ! 📆 Wednesday Oct 12, 1pm PST Register: Come learn about data versioning at *MASSIVE* (100s of PBs) scale, and how @TheTreeverse uses Airbyte!

Community Call | Airbyte - Open-source Data Integration

Join us for our community calls to see how our prominent users leverage Airbyte, and to get some product updates from our engineering team.

airbyte.com

0

5

12

Airbyte

@AirbyteHQ

11 months

🧵 We're super excited to announce the release of the 0.50 version for Airbyte with 3 significant features, now available on both Airbyte Open Source and Cloud: 🔄 Schema propagation 👉 Column selection 🏁 Checkpointing Here's why this is significant for Open-Source ⬇️

2

1

12

Airbyte

@AirbyteHQ

2 years

Did you hear from the most loved language, Rust? Are you curious why and how this might be relevant for data engineering? @sspaeti took a first glanced and checked how it compares to the language of data engineers, Python.

Will Rust Take over Data Engineering? | Airbyte

Python is not the most suitable for Data Engineering. Let's explore why Rust has potential, what it does well and why it has become the most loved programming language for a while.

airbyte.com

1

2

12

Airbyte

@AirbyteHQ

2 years

Hacktoberfest 2022 starts next week! 🎃 From 10/03 to 11/02, we’re having a contest to see who can build the best and most connectors using our low-code CDK (available for Early Access only). We've got cash prizes and more! All details here 👇

0

8

12

Airbyte

@AirbyteHQ

1 year

Hey Python enthusiasts! 😊🐍 Are you eager to create a destination using Python? We've created this in-depth tutorial to guide you through the process. It features example code showcasing the implementation of the DuckDB destination. Happy coding, everyone

How to Create an Airbyte Python Destination: DuckDB | Airbyte

A walk-through on how to create an Airbyte DuckDB destination. All code changes are within a single PR for reference.

airbyte.com

0

1

11