Skip to content
Tiatra, LLCTiatra, LLC
Tiatra, LLC
Information Technology Solutions for Washington, DC Government Agencies
  • Home
  • About Us
  • Services
    • IT Engineering and Support
    • Software Development
    • Information Assurance and Testing
    • Project and Program Management
  • Clients & Partners
  • Careers
  • News
  • Contact
 
  • Home
  • About Us
  • Services
    • IT Engineering and Support
    • Software Development
    • Information Assurance and Testing
    • Project and Program Management
  • Clients & Partners
  • Careers
  • News
  • Contact

8 tips for unleashing the power of unstructured data

Making the most of enterprise data is a top concern for IT leaders today. With organizations seeking to become more data-driven with business decisions, IT leaders must devise data strategies gear toward creating value from data no matter where — or in what form — it resides.

For many enterprises, unstructured data, in the form of text, video, audio, social media, imaging, sensor, and other formats, remains elusive and untapped. While industry research estimates that as much as 90% of enterprise data is unstructured, 61% of IT leaders say managing unstructured data is a problem for their organization, with another 24% not even including unstructured data on their data and analytics short list, according to research from Foundry.

Unstructured data resources can be extremely valuable for gaining business insights and solving problems. The key is figuring out how to create that value. Organizations that become skilled in tapping these vast information resources can gain a significant advantage in delivering actionable insights to key business processes.

Here is a look at how inventive enterprises are transforming unstructured data into business value today, along with some tips on how to put unstructured data to work for your organization.

Enhancing the creative process

At mobile game development company RetroStyle Games, unstructured data has proved to be a “goldmine” that directly contributes to growing the business and improving games, says Ivan Konoval, a data analyst at the company.

Among the numerous ways RetroSyle Games uses unstructured data, perhaps the most impactful are for concept art gathering, and audio data.

“The creative process of our game developers often begins with a sketch, mood board, or concept art,” Konoval says. “These works, while not structured, capture the essence of what we want to express in the game. To ensure that these works do not get lost among others and can be easily found in the future when working on the game’s sequel, we use advanced image recognition tools.”

These tools categorize and tag various elements of the artwork, whether it’s a character, landscape, or some other element. “This allows our artists and developers to quickly find related artwork, which provides design consistency and speeds up the development process,” Konoval says. “In addition, this system allows us to store information about the development of the company’s artwork, which is very useful when training new employees.”

Regarding audio data, voice acting plays a key role in players’ experience in the game world, Konoval says. “We collect a huge amount of data from in-game dialogs, background sounds, and player voice chats,” he says. “Using voice recognition and sound analysis, we extract nuances such as mood and sentiment.”

For example, if a certain dialog results in players consistently entering voice chats with excitement, developers take note of this. Similarly, anomalies such as background noise that does not match the environment are identified and addressed.

“The insights derived from this audio data have directly contributed to improving the game’s audio experience, ensuring that players are constantly emotionally engaged in the gameplay and interacting with the environment,” Konoval says.

Games are dynamic, and so is the data they generate, Konoval says. Features such as in-game chat sentiment analysis needed real-time processing to filter out inappropriate behavior by players. “We’ve addressed this by leveraging stream processing frameworks like Apache Kafka,” he says. “This allows our game moderators to respond in real-time to any emerging patterns and issues.”

With each game release and update, the amount of unstructured data being processed grows exponentially, Konoval says. “This volume of data poses serious challenges in terms of storage and efficient processing,” he says.

To address this problem RetroStyle Games invested in data lakes. “This not only allows us to store huge amounts of unstructured data, but also to query and analyze it efficiently, providing immediate access to the information we need for our data scientists and developers,” Konoval says.

Powering generative AI

Workhuman, a provider of employee recognition and experience software, is leveraging unstructured data in multiple ways on its cloud-based platform, says Jesse Harriott, head of analytics and execute director.

“Unstructured data is the most prevalent form of data, yet the most challenging to use effectively,” Harriott says.

The Workhuman cloud contains millions of recognition messages from employees around the world, sharing positive feedback about someone with whom they work.

“They do this in their own words, so each recognition moment is completely unique,” Harriott says. “We use this data to power AI models that help companies better define how employees are collaborating in their organization, what topics come up most frequently in messages, and whether there is equity in recognition awards across the organization.”

The company also uses large language models (LLMs) to summarize recognition trends over time and to suggest language for an effective recognition message.

“One initiative I’m particularly proud of is our tool Inclusion Advisor, an in-the-moment AI-based coaching tool that identifies and suggests corrections for unconscious bias in award language before it is sent to the recipient,” Harriott says.

One of the biggest challenges of getting value out of unstructured data is limited access to reliable and valid training data for the business use cases that are the focus for the organization.

“You can have large amounts of unstructured data, but without effective training data to create and validate a model, progress and quality will suffer,” Harriott says. “Leveraging LLMs can certainly help in this regard, but many business use cases are not effectively captured by existing LLMs.”

In addition, “in an LLM there can still be the issue of bias in the training data,” Harriott says. Workhuman has a linguistics team that is responsible for data annotation, augmentation, and validation to deal with some of these issues. “We also partner with our large, multinational customers to make sure models yield meaningful and useful results,” Harriott says.

Tips for transforming unstructured data into value

Harriott, Konoval, and other data experts offer advice on how to ensure success when working with unstructured data.

1. Tie initiatives to business outcomes. IT leaders should make sure initiatives to leverage unstructured data are tightly aligned to business needs and have executive sponsorship, Harriott says.

“Too often, a team may have a creative use case for unstructured data, but the connection to a key business outcome is not obvious to others and may lose support,” Harriott says. “It’s the leader’s responsibility to educate the organization on why the use case is important and how it can directly or indirectly drive business benefit.”

2. Recognize the journey. Also, data leaders should set and celebrate initiative milestones as they are met, especially given how difficult the challenge of creating value with unstructured data can be. 

“Making unstructured data actionable may require more time and effort than the business expects,” Harriott says. “By recognizing milestones, leaders give other stakeholders visibility into the progress being made, and also ensure that their team members feel appreciated for the level of effort they are putting in to make unstructured data actionable.”

3. Quality is job one. Another key to success is to prioritize data quality.

“The adage ‘garbage in, garbage out’ couldn’t be more appropriate,” Konoval says. “Going into analysis without ensuring data quality can be counterproductive. We have always taken this approach: Clean the data, remove what is unnecessary, and ensure that it meets quality standards.”

In the gaming industry, “misinformed decisions can result in expensive feature developments that players might not resonate with, or even worse, bugs that could tarnish our reputation,” Konoval says. “Our rigorous data governance framework ensures the foundation of our analyses is rock-solid.”

4. Separate the actionable from the informative. Prioritizing data that business users can act on is also vital. “What’s important is the volume of data and being able to parse what is actionable versus what is informative,” says Joe Minarik, COO at colocation and data services provider DataBank.

To underscore the importance of this, Minarik gives the example of using unstructured data for systems monitoring. “Actionable aspects have to be prioritized and addressed quickly,” he says. “Because so many aspects of systems are monitored, a single issue can generate alarms and information from downstream devices, causing an overabundance of alerts, alarms, and information that needs to be sifted through to identify what single aspect really needs to be addressed.”

5. Make ample use of AI. Continuing with his example, Minarik points out the valuable role AI and machine learning play in analyzing unstructured data streams over time. “It helps you build system correlation,” he says. “That allows you to drop the noise and get to the root issue immediately.”

For instance, organizations can deploy named entity recognition (NER), a component of natural language processing (NLP) that focuses on identifying and categorizing named entities within unstructured text, with tags such as “person,” “organization,” or “location.”

“In practical terms, entity recognition plays a crucial role in a multitude of applications,” Minarik says. These include information retrieval systems that index and organize content, question-answering systems that locate answers within text, and content recommendation engines that personalize content based on recognized entities.

“By identifying and categorizing named entities, NER empowers data analysts and system engineers to unlock valuable insights from the vast data collected,” Minarik says.

6. Ensure value with visualizations. The process of making unstructured data usable doesn’t end with analysis, Minarik says. It culminates in the reporting and communication of findings.

“Reports typically involve a structured presentation of key findings, methodologies, and the implications of the analysis,” Minarik says. “Visualizations, such as charts, graphs, and dashboards, are instrumental in conveying complex data in an understandable format. Visual representations not only facilitate comprehension but also make it easier for stakeholders to identify trends, outliers, and critical insights, ensuring that timely data-driven decisions are made.”

7. Monitor as you go. Another key practice that is sometimes overlooked is the need for continuous monitoring and maintenance, Minarik says. “Real-life data is dynamic and ever-evolving,” he says. “Continuous monitoring and maintenance are critical to ensuring that the data remains usable over time.”

The key to this is to regularly clean and perform quality checks to maintain data accuracy and reliability, Minarik says. Data anomalies, inconsistencies, and duplicates must be identified and rectified promptly to prevent skewed or erroneous analyses.

8. Keep your team’s skills sharp. Finally, it’s a good practice to invest in the development of the right skills — an effort that, given the constant evolution of underlying tools, must be ongoing.

“The world of data analytics, particularly around unstructured data, is dynamic,” Konoval says. “The smallest advantage, such as a team skilled in the latest image recognition technology and analyzing concept art, can be the difference between a game being a hit or a failure. We’ve already seen how the results of advanced technology have impacted the storytelling and design of our games, resulting in positive feedback and increased player engagement.”

Data Management, Data Mining, Data Science
Read More from This Article: 8 tips for unleashing the power of unstructured data
Source: News

Category: NewsNovember 28, 2023
Tags: art

Post navigation

PreviousPrevious post:Making sense of zero trust – why a managed SASE solution is the ideal option for enterprisesNextNext post:What you don’t know about data management could kill your business

Related posts

Barb Wixom and MIT CISR on managing data like a product
May 30, 2025
Avery Dennison takes culture-first approach to AI transformation
May 30, 2025
The agentic AI assist Stanford University cancer care staff needed
May 30, 2025
Los desafíos de la era de la ‘IA en todas partes’, a fondo en Data & AI Summit 2025
May 30, 2025
“AI 비서가 팀 단위로 지원하는 효과”···퍼플렉시티, AI 프로젝트 10분 완성 도구 ‘랩스’ 출시
May 30, 2025
“ROI는 어디에?” AI 도입을 재고하게 만드는 실패 사례
May 30, 2025
Recent Posts
  • Barb Wixom and MIT CISR on managing data like a product
  • Avery Dennison takes culture-first approach to AI transformation
  • The agentic AI assist Stanford University cancer care staff needed
  • Los desafíos de la era de la ‘IA en todas partes’, a fondo en Data & AI Summit 2025
  • “AI 비서가 팀 단위로 지원하는 효과”···퍼플렉시티, AI 프로젝트 10분 완성 도구 ‘랩스’ 출시
Recent Comments
    Archives
    • May 2025
    • April 2025
    • March 2025
    • February 2025
    • January 2025
    • December 2024
    • November 2024
    • October 2024
    • September 2024
    • August 2024
    • July 2024
    • June 2024
    • May 2024
    • April 2024
    • March 2024
    • February 2024
    • January 2024
    • December 2023
    • November 2023
    • October 2023
    • September 2023
    • August 2023
    • July 2023
    • June 2023
    • May 2023
    • April 2023
    • March 2023
    • February 2023
    • January 2023
    • December 2022
    • November 2022
    • October 2022
    • September 2022
    • August 2022
    • July 2022
    • June 2022
    • May 2022
    • April 2022
    • March 2022
    • February 2022
    • January 2022
    • December 2021
    • November 2021
    • October 2021
    • September 2021
    • August 2021
    • July 2021
    • June 2021
    • May 2021
    • April 2021
    • March 2021
    • February 2021
    • January 2021
    • December 2020
    • November 2020
    • October 2020
    • September 2020
    • August 2020
    • July 2020
    • June 2020
    • May 2020
    • April 2020
    • January 2020
    • December 2019
    • November 2019
    • October 2019
    • September 2019
    • August 2019
    • July 2019
    • June 2019
    • May 2019
    • April 2019
    • March 2019
    • February 2019
    • January 2019
    • December 2018
    • November 2018
    • October 2018
    • September 2018
    • August 2018
    • July 2018
    • June 2018
    • May 2018
    • April 2018
    • March 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • October 2017
    • September 2017
    • August 2017
    • July 2017
    • June 2017
    • May 2017
    • April 2017
    • March 2017
    • February 2017
    • January 2017
    Categories
    • News
    Meta
    • Log in
    • Entries feed
    • Comments feed
    • WordPress.org
    Tiatra LLC.

    Tiatra, LLC, based in the Washington, DC metropolitan area, proudly serves federal government agencies, organizations that work with the government and other commercial businesses and organizations. Tiatra specializes in a broad range of information technology (IT) development and management services incorporating solid engineering, attention to client needs, and meeting or exceeding any security parameters required. Our small yet innovative company is structured with a full complement of the necessary technical experts, working with hands-on management, to provide a high level of service and competitive pricing for your systems and engineering requirements.

    Find us on:

    FacebookTwitterLinkedin

    Submitclear

    Tiatra, LLC
    Copyright 2016. All rights reserved.