Posts

  • State of Data Engineering Q3 2024

    Here is this quarter’s state of data engineering newsletter. There is only a little chat about AI this time, and a focus on Open Table Formats, the Apache Iceberg Rest Spec, Open Table Format updates, and new updates in the Amazon Data Engineering ecosystem. Prompt Engineering – Meta Analysis Whitepaper One of my favorite AI…


  • Braces

    Growing up I had the same dentist from childhood to adulthood. My dentist’s office was run by Dentist Chung (in Vietnamese I called him Bác Sĩ Chung – which means Dr Chung translated directly) and his sister running the office. The office was in Garden Grove, in between the Korean and Vietnamese districts. Walking in…


  • State of Data Engineering 2024 Q2

    State of Data Engineering 2024 Q2

    Data Engineering and AIChip Huyen, who came out of Stanford and is active in the AI space recently wrote an article on what she learned by looking at the 900 most popular open source AI tools. https://huyenchip.com/2024/03/14/ai-oss.html Image Credit: huyenchip’s blog In data engineering, one of our primary usages of AI is really just prompt engineering. Use Case 1: Data Migration…