Skip to content
Tiatra, LLCTiatra, LLC
Tiatra, LLC
Information Technology Solutions for Washington, DC Government Agencies
  • Home
  • About Us
  • Services
    • IT Engineering and Support
    • Software Development
    • Information Assurance and Testing
    • Project and Program Management
  • Clients & Partners
  • Careers
  • News
  • Contact
 
  • Home
  • About Us
  • Services
    • IT Engineering and Support
    • Software Development
    • Information Assurance and Testing
    • Project and Program Management
  • Clients & Partners
  • Careers
  • News
  • Contact

JetBlue optimizes data operations with shift to the cloud

The air travel industry has dealt with significant change and uncertainty in the wake of the COVID-19 pandemic. In 2020, JetBlue Airways decided its competitive advantage depended on IT — in particular, on transforming its data stack to consolidate data operations, operationalize customer feedback, reduce downstream effects of weather and delays, and ensure aircraft safety.

“Back in 2020, the data team at JetBlue began a multi-year transformation of the company’s data stack,” says Ashley Van Name, general manager of data engineering at JetBlue. “The goal was to enable access to more data in near real-time, ensure that data from all critical systems was integrated in one place, and to remove any compute and storage limitations that prevented crewmembers from building advanced analytical products in the past.”

Prior to this effort, JetBlue’s data operations were centered on an on-premises data warehouse that stored information for a handful of key systems. The data was updated on a daily or hourly basis depending on the data set, but that still caused data latency issues.

“This was severely limiting,” Van Name says. “It meant that crewmembers could not build self-service reporting products using real-time data. All operational reporting needed to be built on top of the operational data storage layer, which was highly protected and limited in the amount of compute that could be allocated for reporting purposes.”

Data availability and query performance were also issues. The on-premises data warehouse was a physical system with a pre-provisioned amount of storage and compute, meaning that queries were constantly competing with data storage for resources.

“Given that we couldn’t stop analysts from querying the data they needed, we weren’t able to integrate as many additional data sets as we may have wanted in the warehouse — effectively, in our case, the ‘compute’ requirement won out over storage,” Van Name says.

The system was also limited to running 32 concurrent queries at any one time, which created a queue of queries on a daily basis, contributing to longer query run-times.

The answer? The Long Island City, N.Y.-based airlines decided to look to the cloud.

Near real-time data engine

JetBlue partnered with data cloud specialist Snowflake to transform its data stack, first by moving the company’s data from its legacy on-premises system to the Snowflake data cloud, which Van Name says greatly alleviated many of the company’s most immediate issues.

Ashley Van Name, general manager of data engineering, JetBlue

Ashley Van Name, general manager of data engineering, JetBlue

JetBlue

Jet Blue’s data team then focused on integrating critical data sets that analysts had not previously been able to access in the on-premises system. The team made more than 50 feeds of near real-time data available to analysts, spanning the airline’s flight movement system, crew tracking system, reservations systems, notification managers, check-in-systems, and more. Data from those feeds is available in Snowflake within a minute of being received from source systems.

“We effectively grew our data offerings in Snowflake to greater than 500% of what was available in the on-premise warehouse,” Van Name says.

JetBlue’s data transformation journey is just beginning. Van Name says moving the data into the cloud is just one piece of the puzzle: The next challenge is ensuring that analysts have an easy way to interact with the data available in the platform.

“So far, we have done a lot of work to clean, organize, and standardize our data offerings, but there is still progress to be made,” she says. “We firmly believe that once data is integrated and cleaned, the data team’s focus needs to shift to data curation.”

Data curation is critical to ensuring analysts of all levels can interact with the company’s data, Van Name says, adding that building single, easy-to-use “fact” tables that can answer common questions about a data set will remove the barrier to entry that JetBlue has traditionally seen when new analysts start interacting with data.

In addition to near real-time reporting, the data is also serving as input for machine learning models.

“In addition to data curation, we have begun to accelerate our internal data science initiatives,” says Sai Pradhan Ravuru, general manager of data science and analytics at JetBlue. “Over the past year and a half, a new data science team has been stood up and has been working with the data in Snowflake to build machine learning algorithms that provide predictions about the state of our operations, and also enable us to learn more about our customers and their preferences.”

Ravuru says the data science team is currently working on a large-scale AI product to orchestrate efficiencies at JetBlue.

“The product is powered by second-degree curated data models built in close collaboration between the data engineering and data science teams to refresh the feature stores used in ML products,” Ravuru says. “Several offshoot ecosystems of ML products form the basis of a long-term strategy to fuel each team at JetBlue with predictive insights.”

Navigating change

JetBlue shifted to Snowflake nearly two years ago. Van Name says that over the past year, internal adoption of the platform has increased by almost 75%, as measured by monthly active users. There has also been a greater than 20% increase in the number of self-service reports developed by users.

Sai Pradhan Ravuru, general manager of data science and analytics, JetBlue

Sai Pradhan Ravuru, general manager of data science and analytics, JetBlue

JetBlue

Ravuru says his team has deployed two machine learning models to production, relating to dynamic pricing and customer personalization. Rapid prototyping and iteration are giving the team the ability to operationalize data models and ML products faster with each deployment.

“In addition, curated data models built agnostic of query latencies (i.e., queries per second) offer a flexible online feature store solution for the ML APIs developed by data scientists and AI and ML engineers,” Ravuru says. “Depending on the needs, the data is therefore served up in milliseconds or batches to strategically utilize the real-time streaming pipelines.”

While every company has its own unique challenges, Van Name believes adopting a data-focused mindset is a primary building block for supporting larger-scale change. It is especially important to ensure that leadership understands the current challenges and the technology options in the marketplace that can help alleviate those challenges, she says.

“Sometimes, it is challenging to have insight to all of the data problems that exist within a large organization,” Van Name says. “At JetBlue, we survey our data users on a yearly basis to get their feedback on an official forum. We use those responses to shape our strategy, and to get a better understanding of where we’re doing well and where we have opportunities for improvement. Receiving feedback is easy; putting it to action is where real change can be made.”

Van Name also notes that direct partnership with data-focused leaders throughout the organization is essential.

“Your data stack is only as good as the value that it brings to users,” she says. “As a technical data leader, you can take time to curate the best, most complete, and accurate set of information for your organization, but if no one is using it to make decisions or stay informed, it’s practically worthless. Building relationships with leaders of teams who can make use of the data will help to realize its full value.”

Analytics, Cloud Computing, Data Management


Read More from This Article: JetBlue optimizes data operations with shift to the cloud
Source: News

Category: NewsNovember 2, 2022
Tags: art

Post navigation

PreviousPrevious post:CIO Middle East Promotion: Vendor interview – OracleNextNext post:SASE Reality Check: Security and SD-WAN Integration Journey

Related posts

휴먼컨설팅그룹, HR 솔루션 ‘휴넬’ 업그레이드 발표
May 9, 2025
Epicor expands AI offerings, launches new green initiative
May 9, 2025
MS도 합류··· 구글의 A2A 프로토콜, AI 에이전트 분야의 공용어 될까?
May 9, 2025
오픈AI, 아시아 4국에 데이터 레지던시 도입··· 한국 기업 데이터는 한국 서버에 저장
May 9, 2025
SAS supercharges Viya platform with AI agents, copilots, and synthetic data tools
May 8, 2025
IBM aims to set industry standard for enterprise AI with ITBench SaaS launch
May 8, 2025
Recent Posts
  • 휴먼컨설팅그룹, HR 솔루션 ‘휴넬’ 업그레이드 발표
  • Epicor expands AI offerings, launches new green initiative
  • MS도 합류··· 구글의 A2A 프로토콜, AI 에이전트 분야의 공용어 될까?
  • 오픈AI, 아시아 4국에 데이터 레지던시 도입··· 한국 기업 데이터는 한국 서버에 저장
  • SAS supercharges Viya platform with AI agents, copilots, and synthetic data tools
Recent Comments
    Archives
    • May 2025
    • April 2025
    • March 2025
    • February 2025
    • January 2025
    • December 2024
    • November 2024
    • October 2024
    • September 2024
    • August 2024
    • July 2024
    • June 2024
    • May 2024
    • April 2024
    • March 2024
    • February 2024
    • January 2024
    • December 2023
    • November 2023
    • October 2023
    • September 2023
    • August 2023
    • July 2023
    • June 2023
    • May 2023
    • April 2023
    • March 2023
    • February 2023
    • January 2023
    • December 2022
    • November 2022
    • October 2022
    • September 2022
    • August 2022
    • July 2022
    • June 2022
    • May 2022
    • April 2022
    • March 2022
    • February 2022
    • January 2022
    • December 2021
    • November 2021
    • October 2021
    • September 2021
    • August 2021
    • July 2021
    • June 2021
    • May 2021
    • April 2021
    • March 2021
    • February 2021
    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    Categories
    • News
    Meta
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.org
    Tiatra LLC.

    Tiatra, LLC, based in the Washington, DC metropolitan area, proudly serves federal government agencies, organizations that work with the government and other commercial businesses and organizations. Tiatra specializes in a broad range of information technology (IT) development and management services incorporating solid engineering, attention to client needs, and meeting or exceeding any security parameters required. Our small yet innovative company is structured with a full complement of the necessary technical experts, working with hands-on management, to provide a high level of service and competitive pricing for your systems and engineering requirements.

    Find us on:

    FacebookTwitterLinkedin

    Submitclear

    Tiatra, LLC
    Copyright 2016. All rights reserved.