Data Modeling Articles
Data consumers need data for BI and analytics to make business decisions. But for most organizations, their current data infrastructure isn't keeping up with demand. In a presentation at Data Summit 2022, titled "Building the Open Data Lakehouse," Mark Lyons, senior director, product management, Dremio, explained why more organizations are moving their analytics and BI to an open data lakehouse and how you can build a successful lakehouse strategy.
Posted May 18, 2022
Wednesday's Data Summit 2022 keynotes opened with Laura Sebastian-Coleman, data quality director, Prudential Financial, who discussed "Data Quality Deniers & What We Learn From Them." One of the biggest organizational obstacles to data quality management is basic pessimism about the possibility of managing the quality of data. This is due to lack of clarity—the goals and processes for data quality management have not been defined or have not been understood—and disbelief that the quality of data could be subject to control.
Posted May 18, 2022
At Data Summit 2022, Sudha Viswanathan, staff engineer, Wayfair, presented a talk titled, "Gaining Insights From Clickstream Data." Viswanathan explained that Wayfair's clickstream data refers to data that contains information about customer actions on the Wayfair site, such as what pages were viewed, the products that were clicked, what was added to the cart, which URL brought the customer to Wayfair. This helps Wayfair make data-driven decisions regarding revenue attribution for different marketing channels and improves traffic and test analysis and ad bidding.
Posted May 18, 2022
To turn data into insights and leverage the wealth of information that they are collecting, organizations need to ensure that their data is up-to-date and trustworthy. There is no magic answer. It's a combination of technology and processes. Kevin Campbell, CEO of Syniti, and Phil Fersht, CEO and chief analyst at HFS Research, discussed data value research conducted with Global 2000 C-level executives during their Data Summit 2022 presentation, "Every Problem Is a Data Problem: How Bad Data Is Killing Your Business."
Posted May 17, 2022
"Every company is a data company," Keith Alsheimer, head of marketing, Unravel Data during his Data Summit 2022 presentation. Alsheimer and Chris Santiago, VP solutions engineering, Unravel Data, discussed DataOps and how it can solve big data problems during the presentation. The annual Data Summit conference returned in-person to Boston, May 17-18, 2022, with pre-conference workshops on May 16.
Posted May 17, 2022
At Data Summit 2022, Chris Bergh, CEO and head chef of DataKitchen, shared how to build an internal business case and ways to collect small wins that illustrate the benefits of DataOps at your organization.
Posted May 17, 2022
Data projects that are completed on time, address changing requirements, and deliver value in the real world require a combination of skills and technologies, as well as the right people, according to Marilyn Moise Rousseau, corporate manager database operations, Baptist Health South Florida, who spoke at Data Summit 2022.
Posted May 17, 2022
Around 85% of analytics, big data, and AI projects will fail, despite massive investments of money. It's not new news, but it still reflects on how powerfully design affects speed, scale, and usage. At Data Summit 2022, Brian O'Neill, founder and principal, Designing for Analytics presented his session, "Technically Right, Effectively Wrong: How to Avoid Creating the ML or Analytics Application No Customer Wants to Use."
Posted May 17, 2022
Franz, a supplier of graph database technology for entity-event knowledge graph solutions, has announced AllegroGraph 7.3 with enhanced GraphQL query capabilities for distributed knowledge graphs and enterprise data fabrics. "Now when organizations need to integrate multiple systems from large legacy infrastructures and add new data to deliver a rich AI application—they can do so more quickly and easily using AllegroGraph and GraphQL APIs," said Jans Aasman, CEO of Franz.
Posted May 17, 2022
In order to develop and launch a successful enterprise data and analytics strategy that addresses the pain points of an organization it is necessary to understand the business, including the skills and roles of everyone who works with data, from business executives to business analysts to data scientists, according to Wayne Eckerson, president, Eckerson Group, a consultancy and research firm focused on data and analytics.
Posted May 16, 2022
Machine learning is revolutionizing the process of complex decision-making by enabling the analysis of bigger, more complex datasets and the delivery of faster, more accurate results. At Data Summit 2022, Charna Parkey, VP of product, Kaskada presented "The Basics of Machine Learning" during her workshop session.
Posted May 16, 2022
Knowledge graphs are a valuable tool that organizations can use to manage the vast amounts of data they collect, store, and analyze. At Data Summit 2022, Joseph Hilger, COO, Enterprise Knowledge LLC and Sara Nash, senior consultant, data and information management, Enterprise Knowledge, LLC presented an "Introduction to Knowledge Graphs" during their workshop session.
Posted May 16, 2022
Python has become the default language of solving complex data problems due to its ease of use, plethora of domain-specific software libraries, and stellar community and ecosystem. All of these things have led to the emergence of even more new and easier-to-use frameworks that enable users to scale their Python code.
Posted May 16, 2022
IBM has unveiled a major new release of IBM i—7.5—in addition to a new Technology Refresh (IBM i 7.4 TR6) and a new product called "Merlin," which is short for IBM i Modernization Engine for Lifecycle Integration. The first kinds of tools IBM is introducing with Merlin are tools that help with developing software with the "IBM i Next Gen Apps" approach. "This means that the first release of Merlin focuses on developing code, so it has an integrated development environment (IDE), using a DevOps approach (so it has wizards to help you set up a DevOps environment, or to integrate your IBM i development into an existing DevOps environment), while making it easy to publish and consume function using services. And it does all of this with a browser interface," said Steve Will, the chief architect for IBM i, responsible for strategy and planning related to the OS.
Posted May 16, 2022
The case for increased data automation is clear. "Data teams are spending significant amounts of time on service requests like infrastructure, user provisioning, and incident coordination and communication," said Tina Huang, CTO and founder of Transposit. "Teams today are often manually creating tickets, Slack channels, and Zoom meetings, plus communicating with stakeholders. Data teams must ensure internal customers using data have access to the data they need and real-time updates about interferences with that data." Other tasks ripe for automation include log parsing, correlation, permissions and access, and more.
Posted May 16, 2022
Siren, a provider of Investigative Intelligence analytics, is releasing Siren 12.1, introducing several enhancements and improvements including 360 degrees data visibility, downloadable and editable reports, and data model scalability. The latest iteration of the Siren platform pushes forward what is achievable in the investigative world, launching new capabilities which have been developed in line with rapidly changing investigators requirements to generate insights at machine speed and scale, according to the vendor.
Posted May 09, 2022
The volume, velocity and veracity of today's data deluge has put immense pressure on underlying data platforms and organizations' abilities to manage them effectively. And the pandemic has only exacerbated the problem. According to a 2021 survey, nearly half of digital architects are under high or extremely high pressure to deliver digital projects, but 61% blame legacy technology for making it difficult to complete modernization efforts. That said, databases of all types—SQL, NoSQL, or NewSQL—be they on-prem, cloud, hybrid, or edge, are struggling to navigate this new reality.
Posted May 04, 2022
The value of normalization is in understanding the data well enough to create the normalized design. Pulling out the business rules, business terms, and relationships from the mass of jumbled together raw content is critical. The business rules that result from performing the normalization exercise establish the requirements that need to be satisfied by solutions, whether they are either built or purchased. When an organization creates and maintains a normalized design for the data within the important areas of their business, they reduce work on all future systems.
Posted May 04, 2022
The 9th annual Data Summit conference will be held May 17-18, 2022, at the Hyatt Regency Boston. Pre-conference workshops will take place on May 16, 2022. The program is available for review and a variety of pass options are available to suit individual requirements.
Posted May 04, 2022
Knowledge graphs are driving industry disruption and business transformation by bringing together previously disparate data, using connections for decision support, and adding context to AI applications. DBTA recently held a webinar with Dr. Maya Natarajan, senior director, knowledge graphs, Neo4j and Dr. Jesus Barrasa, senior director, sales engineering, Neo4j who discussed why knowledge graphs are on the rise, how they work, and what the most popular use cases are for enterprises.
Posted May 03, 2022
Airbyte, creators of an open-source data integration platform, is releasing its cloud service for data movement in the U.S. "With Airbyte Cloud, we remove the headache of building and maintaining custom data infrastructure by providing a simple, economical way for enterprises to move data as needed," said Michel Tricot, co-founder and CEO, Airbyte.
Posted April 28, 2022
Ascend.io, the Data Automation Cloud, announced it has received $31 million in Series B funding, enabling the company to scale go-to-market efforts and expand into new geographies, as well as extend Ascend's Data Automation Cloud to support full multi-cloud data mesh automation.
Posted April 28, 2022
Each year, Data Summit features industry-leading experts covering the topics that matter most for data professionals who want to stay on top of the latest technologies and strategies. The conference program is now available for review, and a variety of pass options are being offered, including special pricing for attendees who register early.
Posted April 28, 2022
Digital.ai is unveiling the latest release of its industry-leading AI-Powered DevOps Platform, dubbed Ascension, empowering both private and public sector organizations to unify, secure, and generate predictive insights across the software lifecycle. The Ascension release further enables technology leaders to scale their distributed workforce and connect agile development at the portfolio, team, and individual levels.
Posted April 27, 2022
Rollbar, provider of real-time error monitoring Software as a Service, is offering new and updated software development kits (SDKs) and capabilities. These SDKs keep Rollbar current on both older, but very significant, platforms like .Net, PHP, and Laravel and also the fastest-moving platforms like Apple iOS, React, Typescript, and Flutter.
Posted April 27, 2022
Aerospike Inc. is releasing Aerospike Database 6, a significant new update of the core engine that powers Aerospike Real-time Data Platform, giving developers an environment that supports multiple programming models to build real-time applications with a predictable performance at any scale.
Posted April 27, 2022
SAP is introducing an experience-driven journey to process analytics, correlating experience data from user surveys (whether customer, supplier, or employee) with underlying IT systems to give companies the ability to understand how best to optimize their end-to-end business processes for both operational excellence and customer experience.
Posted April 27, 2022
Oracle has announced that Oracle MySQL HeatWave now supports in-database machine learning (ML) in addition to the previously available transaction processing and analytics. MySQL HeatWave ML fully automates the ML lifecycle and stores all trained models inside the MySQL database, eliminating the need to move data or the model to a machine learning tool or service. Eliminating ETL reduces application complexity, lowers cost, and improves security of both the data and the model. HeatWave ML is included with the MySQL HeatWave database cloud service in all 37 Oracle Cloud Infrastructure (OCI) regions.
Posted April 20, 2022
Startups are always emerging to address challenges and leverage opportunities in innovative ways. The companies bring fresh approaches to accelerating digital transformation, expanding what's possible with analytics, breaking down silos, and more. Here are 15 startups DBTA thinks are worth watching in 2022.
Posted April 18, 2022
Stacklet, developers of a cloud governance as code platform based on the open source Cloud Custodian project, is offering the Stacklet Platform as a Software-as-a-Service (SaaS), making it easier and frictionless for organizations to shift to governance as code model.
Posted April 08, 2022
Database applications have vastly improved in recent years, but despite our best efforts, they can still feel frustratingly slow. A report that is supposed to take minutes might instead (for unknown reasons) take 2 hours. Corporate teams complain that every time they work with the database, it gums up the works, leaving users grumpy and managers suspicious. This is no small matter. According to the SolarWinds Query Report 2021, nearly one-third of data pros surveyed manage more than 300 databases in their organization's environment.
Posted April 07, 2022
Data architects live in a world caged by bars of process, standards, and documented procedures—things many would consider a high ceremony lifestyle. As an industry, information technology has been migrating more and more into agile frameworks for some time now. High ceremony is often seen as an earmark of "waterfall" approaches, which constitute the evil empire that agile frameworks are fighting to replace. The result of this opposition is that formal data architecture groups often do not fold easily into agile approaches.
Posted April 07, 2022
With data increasing at a rapid pace and more companies seeing the need to compete on analytics, there is also more awareness of the essential role of data literacy. As the amount of data created everyday continues to explode, businesses are looking for every advantage they can get to adapt to changing market headwinds
Posted April 07, 2022
The latest Java Development Kit (JDK) provides updates and improvements with nine JDK Enhancement Proposals (JEPs). "The release of Java 18 demonstrates Oracle's continued commitment to provide enterprises and developers faster access to enhancements with the 6-month feature release cadence," said Georges Saab, vice president of development, Java Platform Group, Oracle.
Posted April 06, 2022
LambdaTest, a leading end-to-end cloud-based test orchestration platform, announced it has closed a deal on $45 million in a venture round, enabling the company to further the innovation that will push the boundaries of cloud-based test orchestration in terms of execution speed, performance and reliability.
Posted April 01, 2022
In the world of machine learning (ML), there are a few very important processes which are critical to anyone in the ML space. The first is making sure the data used in machine learning is clean. This topic gets talked about a lot so, while it is very important, let's skip this and move on to the next step. Assuming a clean and complete dataset already exists, the user then proceeds to start training models.
Posted April 01, 2022
With the push to automate increasingly complex data environments, along with a greater need to spur collaboration to deliver more effective and timely analytics capabilities, organizations are turning to DataOps as well as a series of related "Ops" methodologies. Will DataOps—eventually conjoined with DevOps, AIOps, and MLOps—help businesses compete in the digital era? Industry observers point out that these approaches are promising, but a lot of work lies ahead to achieve true collaborative and automated innovation in the data management space.
Posted April 01, 2022
To drive significantly greater productivity and efficiency for increasingly complex chip designs, Synopsys is introducing a new cloud-optimized electronic design automation (EDA) deployment model. Synopsys Cloud provides access to the company's cloud-optimized design and verification products, with pre-optimized infrastructure on Microsoft Azure to address higher levels of interdependencies in chip development.
Posted March 31, 2022
A lot of digital ink has been spilled over the hottest topic in data integration today: the data mesh. But is the data mesh truly achievable for a modern enterprise? And is it truly novel, or simply a rehashing of older paradigms and techniques? DBTA held a webinar with Paul Lacey, Sr. director of product marketing, Matillion who discussed what a decentralized approach to data management could look like in practice.
Posted March 31, 2022
It's time to vote for the annual Database Trends and Applications Readers' Choice Awards, a competition in which the winning information management solutions, products, and services are selected by you, the readers. The voting period will be open through Wednesday, May 11. Winners will be showcased in a special section on the DBTA website and in the August 2022 issue of Database Trends and Applications magazine.
Posted March 28, 2022
Domo is introducing several key enhancements to its cloud-based platform to make it easier than ever to put data to work for everyone, enhancing the speed, scale, and user experience (UX). Included in these platform enhancements are new functionality in Domo Multi-cloud, a new Governance Toolkit and updates to Universal Data Modeling, making it easier to understand, engage and leverage data across any organization, according to the vendor.
Posted March 24, 2022
Rocket Software has relaunched Rocket DevOps software. The goal is to enable CI/CD for IBM i environments, bringing modern DevOps best practices to mission-critical applications, and thereby helping companies to attract and retain developer talent. Rocket says that with a limited number of developers who understand code on IBM i and a generation of talent beginning to retire, organizations must take steps to attract new developers who are qualified to work on important projects but also want to use familiar tools and approaches.
Posted March 21, 2022
Redis, the real-time data platform, is releasing RedisJSON 2.0, enabling customers to more easily modernize existing applications and create entirely new digital experiences requiring real-time access and processing of JSON document files.
Posted March 15, 2022
Often one reads a book or hears a presenter making a pun about relational theory being called "relational" because of entities being "related." Such references are nothing but misplaced puns. Relational theory derives the relational in the name from the idea that a "relation" is a mathematical term synonymous for a "set" and each entity represents a set of some sort. However, relationships between entities are still a very important concept albeit not an eponymous one.
Posted March 11, 2022