Data Quality Articles
Databricks, the Data and AI company, is introducing Databricks LakeFlow, a new solution that unifies and simplifies all aspects of data engineering—from data ingestion to transformation and orchestration. According to Databricks, with LakeFlow, data teams can now simply and efficiently ingest data at scale from databases such as MySQL, Postgres, and Oracle, and enterprise applications such as Salesforce, Dynamics, Sharepoint, Workday, NetSuite, and Google Analytics.
Posted June 24, 2024
DigitalOcean is introducing Managed OpenSearch, a comprehensive solution designed for in-depth log analysis, simplifying troubleshooting, and optimizing application performance. According to the company, traditional log management solutions can be complex, costly, and time-consuming. That's where Managed OpenSearch comes in. It's a powerful, user-friendly platform that makes it easy to gather and analyze application logs.
Posted June 24, 2024
DiffusionData, a pioneer and leader in real-time data streaming, is collaborating with Technaura, a Germany-based IT consultancy specializing in the provision of real-time data solutions and services—combining their offerings to provide markets such as financial services, IoT, telco, and healthcare with reliable and secure real-time data distribution at Internet scale.
Posted June 21, 2024
Datadobi, a global leader in hybrid cloud data services, is releasing StorageMAP 7.0, offering new features that provide deeper insights into unstructured data environments, facilitate informed decision-making, and enable policy driven data placement. These advancements are in direct response to the urgent need for businesses to manage the acute risk, cost, and opportunity associated with the rapidly increasing volume of unstructured data that is inundating most enterprises, according to Datadobi.
Posted June 21, 2024
To examine enabling technologies and best practices for adopting a data fabric architecture, experts from TimeXtender and Acceldata joined DBTA's webinar, Moving to a Data Fabric: Key Challenges and Enabling Technologies, offering an amalgamation of strategies for navigating this otherwise elusive—yet vitally modern—infrastructure.
Posted June 20, 2024
Gigamon, a leading deep observability company, is launching a new initiative to help customers gain greater visibility into their hybrid cloud infrastructure to better secure and manage it. The Gigamon Power of 3 Cloud Integration Initiative uniquely brings together Gigamon, a Gigamon channel partner, and a leading networking, security, or observability technology alliance partner to provide customers with access to technology integrations and support that will help deploy and manage solutions more efficiently, according to the company.
Posted June 20, 2024
Siren, the all-in-one investigation company, is releasing the latest version of its software, presenting investigators with a pre-built intelligence graph that hastens the investigation process. Siren 14.2 automatically makes complex connections from large volumes of disparate data, surfacing previously inaccessible intelligence and improving effectiveness, according to the company.
Posted June 19, 2024
Airbyte, creator of the leading open-source data movement infrastructure, is releasing its Snowflake Cortex destination, a new data connector for Snowflake users who are interested in building generative AI (GenAI) capabilities directly within their existing Snowflake accounts.
Posted June 19, 2024
Tigera, the creator of Project Calico, is introducing Calico Cluster Mesh, delivering on its approach to secure microservices communication. According to the company, Calico Cluster Mesh delivers the benefits of a service mesh without the added complexity and latency of a traditional service mesh solution.
Posted June 19, 2024
DataBee, from Comcast Technology Solutions (CTS), is offering new capabilities in its DataBee Hive security, risk, and compliance data fabric platform—introducing DataBee EntityViews. DataBee EntityViews, powered by a patent-pending entity resolution technology, brings automated detection chaining that improves threat hunting, security detection fidelity, and insider risk monitoring, according to the company.
Posted June 18, 2024
AI is only accelerating its adoption among global corporate enterprises, thus CEOs and business leaders are positioned at the confluence of innovation and ethics as it relates to implementing AI projects in their businesses. While technical prowess and business potential are usually the focus of conversations around AI, the ethical considerations are sometimes overlooked, especially those that aren't immediately obvious.
Posted June 18, 2024
DataStrike, a leader in data infrastructure services, has completed the acquisition of database and cloud management pioneer MiCORE, forming one of the largest managed service providers (MSP) specializing in data infrastructure services for small- and mid-sized businesses (SMBs).
Posted June 17, 2024
Gretel, a provider of synthetic data generation, is releasing Gretel Navigator, an agent-based, compound generative AI system built to automate data creation and curation processes for AI development. With simple natural language or SQL prompts, Gretel Navigator enables users to create, edit, and augment tabular data, and design realistic, high-quality test and training datasets from scratch, according to the company.
Posted June 17, 2024
Alation, Inc., the data intelligence company, is deepening its integration with Databricks to offer trusted data for AI initiatives to the enterprise—strengthening the partnership through the Alation Open Data Quality Initiative improves data reliability, streamlines compliance, and facilitates effective decision-making.
Posted June 17, 2024
Pliops, a provider of data processors for cloud and enterprise data centers, is delivering broad-spectrum workload acceleration with its Extreme Data Processor (XDP). The company is also collaborating with scale-out software provider Hammerspace and will introduce a new joint solution.
Posted June 17, 2024
Hammerspace, the company orchestrating the next data cycle, is adding the S3 interface to its Global Data Platform, advancing the orchestration of existing data sets to available compute resources. With this announcement, Hammerspace continues to offer organizations new, advantageous ways to manage and leverage data, according to the company.
Posted June 17, 2024
Cirata, the company that automates Hadoop data transfer and integration to modern cloud analytics and AI platforms, is now offering support for IBM General Parallel File System (GPFS), a cluster file system used as storage for IBM Spectrum Scale data lakes. The new Live GPFS support, which is included in the recent release of Cirata Data Migrator 2.5, dramatically reduces latency between storage changes and replication or migration outcomes while also enhancing the performance and scale of GPFS-resident data assets migrating to the cloud, according to the company.
Posted June 17, 2024
In today's tumultuous computing landscape, the DBMS (database management system) remains core and central to the IT infrastructure. And, as such, it is central to the applications used by modern organizations to conduct business and service their customers. So, it stands to reason that a core competency for a DBA is to be able to keep their organization's databases up and operational. This requires resilience.
Posted June 17, 2024
Qumulo, the simple way to manage exabyte-scale data anywhere, is joining the Ultra Ethernet Consortium—becoming one of the first Networked Storage suppliers to enlist. Additionally, Qumulo announced a collaboration with Intel Corporation and Arista Networks to advance the state-of-the-art in IT infrastructure at the intersection of networking, storage, and data management.
Posted June 17, 2024
Keebo is introducing Workload Intelligence, Powered by Snowflake on the Snowflake Marketplace, enabling joint customers to gain full visibility into their costs, identify their performance bottlenecks, identify their inefficient queries, and advise their data teams to take advantage of optimization opportunities.
Posted June 13, 2024
Never before has the business spotlight been on database managers and professionals as it is at this time. Every business leader now wants a data-driven organization, as they recognize this is the key to competitive differentiation. Data monetization is seen as a vast new revenue source. AI—both operational and generative—relies on effective data management and quality. The ongoing transition to digital business demands real-time delivery of insights to end users and applications.
Posted June 13, 2024
Two surveys show that many executives are skeptical they can move forward with AI demands, which include the right data, at the right time. AI is a high priority, and is in production at most sites, but supplying trustworthy data is still a challenge at the back end.
Posted June 13, 2024
DevOps is now the most prevalent software development methodology in use. Since 2009, it has spread beyond development teams into other functional areas. One of the earlier DevOps extensions was into DevTestOps, which emphasized continuous testing throughout the software development lifecycle. This was followed several years later by the emergence of QAOps, which built on that model with a focus on improved quality assurance (QA). At first glance, these terms refer to the same methodology. But when you dig deeper, QAOps represents a significant departure from the purpose and process of DevOps. Let's explore.
Posted June 13, 2024
Data modeling has always had a push-me/pull-you relationship in the IT world. The idea of complete logical and physical data models, insightful definitions, coherent data flow diagrams, and other related informational caches is always desirable. However, far too often, the expectation is that these activities take virtually no time to create. When the expenditure of resources goes beyond a certain level, the activities are jettisoned or otherwise given the short shrift. Actually, getting code in place is viewed as the only evidence of true progress.
Posted June 13, 2024
The world of open source has moved from being a niche interest that was the province of academics and self-described geeks to the mainstream. From being the purview of free software interest groups, open source is now ubiquitous. According to OpenUK, open source is used by 78% of private enterprises, and open source components and code are present in roughly 97% of all applications, proprietary or otherwise.
Posted June 13, 2024
Most times, if asked, I will rattle off, without hesitation, a list of ways AI is being applied along with all the ways it can go wrong. You may also get bit of a diatribe about why speaking of AI in the royal sense (i.e., "the AI") is always a bad idea. It's practically a (bad) party trick. Yet recently, when asked to characterize the primary ethical issues in AI, I had a perfect moment of mental blankness. It was an uncomfortable and instructive moment on many fronts.
Posted June 12, 2024
Ben Slater, CPO, Instaclustr by NetApp, joined DBTA's webinar, The World's Largest Apache Kafka and Apache Cassandra Migration: Lessons Learned and Best Practices, shared their firsthand experience in managing a migration project of colossal scale, delivering valuable insights in areas such as planning, security, performance optimization, monitoring, and more.
Posted June 12, 2024
Apica, the leader in data management and active observability, is debuting version 2.0 of the Apica Ascent Platform, acting as a culmination of Apica's recently acquired entities—LOGIQ.AI, a data fabric innovator, and Circonus, a telemetry data management provider. Incorporating the features from both acquired companies' platforms, Ascent platform 2.0 empowers organizations with deeper, more enriched insights into data management, further simplifying how customers gather and apply their data to systems and platforms.
Posted June 12, 2024
Hitachi Vantara, the data storage, infrastructure, and hybrid cloud management subsidiary of Hitachi, Ltd., is developing of high-performance and energy-efficient hybrid cloud and database solutions. The new, highly-performant AMD EPYC CPU-powered Hitachi Vantara hybrid cloud solutions combine converged and hyperconverged solutions, including Hitachi Unified Compute Platform (UCP), with 4th Gen AMD EPYC processors.
Posted June 12, 2024
MotherDuck, builder of a serverless, easy to use data analytics platform based on open source database DuckDB, is announcing the general availability of MotherDuck, providing users with the ability to use DuckDB's simplicity at scale. DuckDB 1.0, which was recently announced by DuckDB Foundation and Labs, provides a scale-up approach to analytics that is faster, cheaper, and more user-friendly than distributed architectures, according to the company.
Posted June 12, 2024
Cloudera, the data company for trusted enterprise AI, is acquiring Verta's Operational AI Platform—further solidifying Cloudera's position in the AI landscape. The Verta team will join Cloudera's machine learning group, reporting to chief product officer, Dipto Chakravarty. The Verta team will draw on their collective expertise to help drive Cloudera's AI roadmap and enable the company to effectively anticipate the needs of its global customer base, according to Cloudera.
Posted June 11, 2024
To gain insight on the adoption and maturity of data management technologies and practices, DBTA and Radiant Advisors surveyed more than 250 IT leaders and professionals at organizations across North America to identify the key perceptions, priorities, challenges, and technology plans underlying modernization efforts today.
Posted June 11, 2024
Cube, the provider of the universal semantic layer for every data app, is announcing the completion of its latest funding round—led by new investor Databricks Ventures—having raised $25 million. Seeing participation from existing investors Decibel, Bain Capital Ventures, Eniac Ventures, and 645 Ventures, this latest funding round will help Cube invest in its growth and development strategies for its flagship product, Cube Cloud.
Posted June 10, 2024
Alation, the data intelligence company, is announcing that it has expanded its partnership with Snowflake, enabling Alation's Open Data Quality Framework to now support integration with Snowflake Horizon. This integration aims to empower enterprises to surface and remediate data quality issues before they impact downstream business and data operations, driving better governance, faster, more accurate AI model development, and more trusted decision making, according to Alation.
Posted June 10, 2024
Darktrace, a global leader in cybersecurity AI, is introducing its new service offering, Darktrace Managed Detection and Response (MDR), combining its detection and response capabilities spanning across the enterprise, with the expertise of its global analyst team. According to Darktrace, this powerful combination augments internal security teams with AI-powered threat containment and expert alert management across Darktrace environments, allowing them to focus resources on more strategic security efforts, like improving cyber resilience.
Posted June 10, 2024
DBI Software, a provider of performance monitoring, tuning, and trending tools for IBM Db2 LUW and SQL Server databases, is releasing version 10 of the DBI Web Performance Suite.
Posted June 07, 2024
Bigeye, the enterprise-grade data observability platform for modern and legacy data stacks, is announcing support for column-level lineage for ETL platforms, bringing extended visibility to enterprises' hybrid data environments. This release empowers organizations with both on-prem sources and cloud data warehouses to map the entire lineage of their data analytics pipeline, ushering in more holistic insights on data quality.
Posted June 07, 2024
Digital.ai, an industry-leading technology company, is introducing Erawan, the next iteration of its open, AI-powered DevSecOps platform, delivering on the company's mission to provide global enterprises with a powerful solution that supports the delivery of high-quality software applications at scale.
Posted June 07, 2024
Galileo, a provider developing generative AI for the enterprise, is releasing Galileo Luna, a suite of Evaluation Foundation Models (EFMs) designed to transform how generative AI evaluations are conducted. According to the company, this novel approach is faster, more cost-effective, and more accurate than existing evaluation methods such as askGPT and human "vibe checks." With Galileo Luna, enterprises can bring trustworthy AI solutions to market faster and at production scale.
Posted June 07, 2024
Data breaches and cyberattacks are only getting more sophisticated at an alarmingly fast pace. In 2024 so far alone, there have been approximately 875,603,100 known records breached in 1,819 publicly disclosed incidents, as reported by It Governance. Since most attacks focus on identity, theft of credentials, or human error, Ev Kontsevoy, CEO of Teleport, believes security must be a company's philosophy from Day One.
Posted June 06, 2024
CloudZero, a globally trusted leader in proactive cloud cost efficiency, announced that the company is now a validated Databricks partner, making it one of the first and only cloud cost optimization platforms accepted into the Databricks partner program. As part of the newly announced partnership, CloudZero developed a new in-platform Databricks cost adaptor that helps customers to visualize and explore 100% of their Databricks spend.
Posted June 06, 2024
Guiding enterprises through the thicket of the latest database technologies and strategies, experts joined DBTA's roundtable webinar, New Database Technologies and Strategies for the AI Era, to offer their expertise on the market's best solutions for supporting AI projects.
Posted June 06, 2024
Matillion, the modern data pipeline platform provider, is bringing no-code Generative AI (GenAI) to Snowflake users with new GenAI capabilities and integrations with Snowflake Cortex AI, Snowflake ML Functions, and support for Snowpark Container Services.
Posted June 06, 2024
SnapLogic, a leader in generative integration, is offering new connectivity and support for Snowflake vector data types, Snowflake Cortex, and Streamlit, assisting companies modernize their businesses and accelerate the creation of generative AI applications.
Posted June 05, 2024
AI has become pervasive across enterprises, and the drive is now on to push this potentially powerful intelligence out to the edge and network, where it can deliver insight and operational performance in real time. These days, no discussion of edge and IoT is complete without weighing the implications of AI. "If people think AI will stop at data centers, they have an unfortunate blind spot, because AI is likely to be deployed in some form at the edge," said Kevin Brown, SVP at Schneider Electric. "In my opinion, it will bring with it a host of new challenges regarding data privacy concerns, an increasing demand for power, and an infrastructure that will be even more broadly distributed. Undoubtedly, we need to get ahead of these challenges."
Posted June 05, 2024
Oracle announced that Charleston Area Medical Center, Inc. is seeing success with Oracle Health RevElate Patient Accounting, improving its billing accuracy, accelerating reimbursements, and strengthening its financial position. CAMC has implemented RevElate Patient Accounting, an electronic health record-agnostic solution, in its ambulatory clinics and four of its Charleston facilities.
Posted June 05, 2024
Oracle is releasing Oracle Linux 8 Update 10 for the 64-bit Intel and AMD (x86_64) and 64-bit Arm (aarch64) platforms is designed for distributed computing environments. Oracle Linux sources, binaries, ISOs, and errata continue to be readily accessible and freely available from the Oracle Linux yum server, without any restrictions.
Posted June 05, 2024
A first and important step in being successful at almost any job or task is understanding oneself. This is true for engineers, modelers, or even architects. Do you know how to perform your tasks? Are you faster or slower than others doing the same tasks? Do you have more or less errors in your output than others? It seems that a rising number of people are so uncomfortable with competing that they may even avoid asking these kinds of questions of themselves; but this is not about competition, it is about understanding oneself, it is about being responsible, it is about holding oneself accountable.
Posted June 05, 2024