Data Warehousing Articles
Is it getting easier or more difficult to lock down data in today's digital enterprises? Industry leaders have mixed opinions on the state of that challenge. Cloud vendors promise industrial-grade security for backend applications and data, while at the same time the move to cloud increases complexity.
Posted October 06, 2022
Things break and the DBA must be prepared for situations where a failure impacts the availability, integrity, or usability of a database. Reacting to failures and service disruptions is a key component of the DBA's job. This means ensuring that appropriate backups are taken for all your critical database objects. Assuming backups exist, when an inevitable database recovery is required, the next decision is how to get the data you need back as quickly as possible. But there are several different types and methods of performing recovery.
Posted October 06, 2022
British mathematician Clive Humby famously said in 2006 that "Data is the new oil." In the 16 years since, companies of all sizes have drilled for and stored more and more data about their customers and business operations to drive performance and growth to reach their goals. In conjunction with the increased use of the consumer internet, data creation has exploded in recent years—considering the majority of the world's data collected over the course of human history has occurred in just the last two years alone. As a result, entire businesses and industries have been built solely on having access to unique and useful data.
Posted October 06, 2022
DiffusionData, previously known as Push Technology, is announcing its brand realignment to solidify its position as a provider of real-time data streaming, messaging solutions, and digital transformation solutions.
Posted October 06, 2022
As technology has rapidly expanded and evolved to its present-day iteration, its own unique challenges have surfaced as well; issues like data ethics and data privacy have cultivated the modern technological landscape, as assaults to those ideals have become wildly relevant to the everyday tech user's digital identity.
Posted October 05, 2022
Every organization, from the smallest nonprofit entities to the trillion-dollar behemoths dominating the historic landscape south of San Francisco, recognizes that tomorrow is not guaranteed. In the early days of this decade, the world's governments put the world economy into existential peril as they attempted to "lock down" public interaction, resulting in the world's economies shutting down. Even when the most destructive restrictions were loosened, there was a considerable amount of less onerous restrictions which lingered on for many months.
Posted October 04, 2022
IBM announced it will add Red Hat storage product roadmaps and Red Hat associate teams to the IBM Storage business unit, bringing consistent application and data storage across on-premises infrastructure and cloud. With the move, IBM will integrate the storage technologies from Red Hat OpenShift Data Foundation (ODF) as the foundation for IBM Spectrum Fusion. This combines IBM and Red Hat's container storage technologies for data services and helps accelerate IBM's capabilities in the burgeoning Kubernetes platform market.
Posted October 04, 2022
IBM plans to acquire Dialexa, a leading U.S. digital product engineering services firm, to help companies drive innovation and achieve their digital growth agendas. The acquisition is expected to deepen IBM's product engineering expertise and provide end-to-end digital transformation services for clients.
Posted October 03, 2022
IBM announced it's extending the data-resilience capabilities of existing IBM data protection products and introducing new workload-specific solutions for SAP HANA and Salesforce. The IBM Safeguarded Copy capability, which currently enables IBM FlashSystem and IBM DS8000 clients to create cyber-resilient immutable snapshots, is now available to clients running IBM's Spectrum Scale high-performance global data platform, bringing logical air-gapping to unstructured data sets. This solution provides organizations with a consistent approach to safeguarding data, regardless of where it's located or how it scales up or out, according to IBM.
Posted October 03, 2022
DataRobot is releasing DataRobot Dedicated Managed AI Cloud, a dedicated hosted version of AI Cloud managed by DataRobot experts. Dedicated Managed AI Cloud provides the latest DataRobot capabilities to support critical AI and machine learning projects with the advantage of public cloud services, reducing cost and time-to-value in deploying, upgrading, and managing the AI infrastructure, according to the vendor.
Posted September 29, 2022
The open-source data platform purpose-built for time-series data, TDengine, is announcing its launch of TDengine Cloud for enterprises seeking to initialize, scale, and operate the TDengine time-series data platform with ease in AWS, Azure, and Google Cloud.
Posted September 29, 2022
Open source cloud data platform company, Aiven, is unveiling its beta launch of Aiven for ClickHouse, initially debuted at Uptime—the company's first annual developer conference. The beta iteration of Aiven for ClickHouse introduces the enterprise to the cloud data warehousing market, allowing for accelerated open source columnar database access for Aiven customers. Users seeking to employ high-performance analytics for critical business insights will have Aiven ClickHouse's fully managed cloud data warehouse in their Aiven toolbelt.
Posted September 29, 2022
Alation Inc., a provider of enterprise data intelligence solutions, is launching the Alation Cloud Service for Snowflake, offering departments and organizations of all sizes to start cataloging data on Snowflake's platform. The new offering, launched in partnership with Snowflake, makes data governance easy and accessible, enabling organizations to start small, flexibly expand by adding data connectors, users, and data objects, and support use cases like cloud data migration for less than $100k, according to the vendors.
Posted September 29, 2022
Is the mainframe still necessary? Well, let's put it this way: If all the world's mainframes shut down, we'd be facing a zombie apocalypse. That's a bit hyperbolic but the underlying point stands: Without mainframes, banks couldn't process financial transactions at ATMs or online, retailers' ecommerce platforms would go dark, and healthcare systems would be unable to access patient records or other vital information. Mainframes are still a vital part of the modern enterprise. If they no longer existed, businesses would lose access to years of records and entire computing systems would crash.
Posted September 28, 2022
StormForge, provider of cloud-native application performance testing and resource optimization, is unveiling the latest capabilities of its StormForge Optimize Live solution, featuring bi-dimensional Kubernetes pod autoscaling—now available within the platform.
Posted September 28, 2022
The big data world is changing in ways never seen before, particularly when it comes to bringing data together and into situations where it can be actionable for the business. The challenge faced by all enterprises—large and small—is being able to discover, identify, and bring the data needed to build products, deliver services, and understand customers. Data integration itself has been a practice—and challenge—for decades. Now, however, new tools and processes are enabling new ways of bringing enterprises to a state in which it can support sophisticated applications such as artificial intelligence, machine learning, and the Internet of Things.
Posted September 27, 2022
HEAVY.AI, an innovator in advanced analytics, is introducing HeavyRF, an extension of the company's deep analytics platform that uses NVIDIA Omniverse to create digital twins that help telco network operators speed deployments of wireless networks.
Posted September 27, 2022
DBTA recently held a webinar titled, "How Cisco Provides World-Class Technology Conference Experiences Using Automation, Programmability, Python, InfluxDB and Grafana," featuring speaker Jason Davis, distinguished services engineer for DevNet at Cisco Systems, to discuss the precise approaches taken by Cisco during CiscoLive events that improve network performance, availability, resiliency, and observability through automation.
Posted September 26, 2022
Modern applications require databases that can constantly adapt to their real-time needs, introducing a variety of complexities when it comes to selecting the right database for the job. The era of the one-size-fits-all approach by employing a singular database is no longer viable; databases crafted for the specific demands of applications are the present—and future—of effective application development and maintenance. AWS Databases, which are purpose-built for a variety of application needs, are the solution amid complexity.
Posted September 22, 2022
Kyndryl, provider of managed IT services, is unveiling Kyndryl Bridge as the latest in Kyndryl's digital integration initiatives. Through real-time, AI-powered analytics and insights for enterprise IT estates, Kyndryl Bridge enables advanced customization and control over mission critical operations. The aim for the platform is to offer enhanced visibility within an organization's operations to prevent potential issues and act on them before they trickle down to affect business operations. Further, the enterprise aims to provide enhanced observability and analytics for modernizing enterprise functions, positioning businesses to be more competitive in a quickly evolving market.
Posted September 21, 2022
Global provider of modern data integration, Fivetran, is debuting the availability of its Metadata API for advanced data tracking within Fivetran-managed pipelines. Data access control is key to Fivetran's latest API, tracking in-flight data from source to target to provide deep insights regarding governance and observability tool employment—allowing users to know who is accessing what data.
Posted September 21, 2022
Relational databases, once the epitome of data management technology, are becoming increasingly archaic as single servers lack the nuance to support the large quantities of data generated by modern enterprises. NoSQL databases offer a solution to legacy database architectures, offering scalable, consistent performance—but how do you migrate such large quantities of data without overcomplicating a new architecture?
Posted September 19, 2022
Data has only become more important as organizations look ahead to what a post-pandemic world could look like. Some of the new approaches being embraced to help drive greater benefit from data are DevOps and DataOps, data quality and governance initiatives, hybrid and multi-cloud architectures, IoT and edge computing, and a range of next-gen databases.
Posted September 14, 2022
Google recently announced their "Simplicity Sprint" initiative, which focuses on improving efficiencies within their workforce during this uncertain economic environment impacted by the ongoing pandemic, supply chain issues, the war in Ukraine, inflation, and the Great Resignation. However, simplifying and creating a more productive workforce is about more than improving focus, it's about uncovering and solving for increased complexity, brought on by an explosion of data, digital transformation initiatives, and the new reality of hybrid work. It is important for businesses and leaders to understand where these complexities are and what the key drivers are before redefining a new strategy to reduce business complexity.
Posted September 14, 2022
Within the realm of data science, deep learning frameworks are predominantly delivered via software found in the Python ecosystem. When looking at the options in the space, it may appear to some as a battle for supremacy, or for one to reign supreme, but the reality is that for a variety of reasons people have their favorites. Calling this a "war" is perhaps being a bit overdramatic.
Posted September 13, 2022
The company behind vendor-neutral unstructured data management, Datadobi, is debuting its latest release of StorageMAP, consisting of a variety of improvements particularly targeting orphaned data. StorageMAP, Datadobi's multi-vendor, multi-cloud data management platform, is a streamlined approach to unstructured data management to declutter and organize an enterprise's data storage. The 6.2 release for StorageMAP tackles orphan data's effect on enterprise resources, enabling IT teams to lower cost, carbon footprint, and risk.
Posted September 13, 2022
Collaboration between MariaDB Corporation, provider of pluggable, propose-built storage engines for specialized workloads, and Qlik, an enterprise focused on offering real-time data integration and analytics solutions, ushers in efficient data migrations with Qlik's data integration platform from legacy database architectures to MariaDB's database solutions. Migration destinations such as MariaDB Enterprise Server, MariaDB Xpand distributed SQL database, or MariaDB SkySQL cloud database service are available for workloads locked in legacy database sources, such as Oracle or Microsoft SQL Server.
Posted September 09, 2022
Data observability is a relatively new discipline in the fields of data engineering and data management. While many are familiar with the longstanding concepts of observability and monitoring in enterprise IT networks and infrastructure, data observability has only really come into the spotlight in the last two years. However, it has managed to turn a lot of heads in that short time.
Posted September 08, 2022
In building a logical data model, some entities are considered strong, other entities are considered weak. Strong entities are the most foundational elements within a nascent Entity-Relationship Diagram (ERD) and comprise the list of objects that would likely come to mind first. Strong entities are independent in that they exist all on their own and can be created without having to meet any pre-conditions.
Posted September 08, 2022
Establishing agreed upon services levels for database applications is of the utmost importance for assuring that performance meets required criteria. Without pre-determined, negotiated service level agreements in place, database and application performance can become a never-ending game of blind man's bluff, where DBAs blindly and constantly seek an unspoken goal. Instead, active service level management should be the standard.
Posted September 08, 2022
Global, cloud-led, data-centric software company, NetApp, is announcing an expansion of their continued global alliance with VMware, Inc., a provider of multi-cloud services for all applications. As a partnership spanning over 20 years of alliance, the enterprises maintain their commitment towards mitigating cost, complexity, and risk of migrating and modernizing workloads in multi-cloud environments via various solutions and go-to-market strategies.
Posted September 07, 2022
NoSQL databases, also referred to as non-relational, continue to grow in popularity both on-premises and in the cloud. Of the 395 different database management systems tracked by site DB-engines, more than half are non-relational. These include key-value, document, graph, time series, and many more database models that fall into the NoSQL category. As more organizations modernize their applications or develop new applications from scratch, they adopt a microservices-based architecture that allows them to take advantage of the benefits of NoSQL databases
Posted September 06, 2022
Microsoft SQL Server is a relational database service that supports transactional processing and analytics. With a 30-plus year history, SQL Server has been a mainstay at many organizations. Now, however, open-source technologies like PostgreSQL, have become increasingly popular for customers. More and more customers are migrating to them from overpriced, restrictive commercial databases that lock them in. With an increasing array of choices, the same organizations are looking for lower cost options, including low-cost, cloud-native, fully managed database services like Amazon Aurora PostgreSQL-Compatible Edition, as this lowers total cost of ownership while providing the desired performance.
Posted September 06, 2022
VMware Inc., provider of multi-cloud services for all apps, and IBM, global hybrid cloud and AI, and business services provider, are announcing an expansion of their 20-plus year partnership with the aims of aiding global customers and partners modernize mission-critical workloads and accelerate time to value in hybrid cloud environments, according to the companies. The partnership expansion takes shape in IBM Consulting as a VMware GSI partner, as well as in jointly engineered solutions and development to add to their previous jointly developed technologies such as data encryption in motion and in use. With relevance spanning multiple industries such as financial services, healthcare, and the public sector, the ecosystem partnership invites solutions with reduced cost, complexity, and risk for cloud migration of mission-critical workloads.
Posted September 06, 2022
Leading platform for environments-as-a-service, Quali, is announcing its recent partnership with Interas Labs, a software engineering company that specializes in container orchestration, cloud-native architecture, microservices transformation, and GitOps. This collaboration improves engineering roadmap facilitation—with Interas Labs' optimizations and Quali's power in orchestration.
Posted August 30, 2022
Teradata, the connected multi-cloud data platform for enterprise analytics, is debuting VantageCloud Lake— the first product from Teradata that is built on a new, next-generation, cloud-native architecture. Leveraging the advantages of Teradata Vantage, renamed to VantageCloud Enterprise, VantageCloud Lake aims to bring a flexible, low-cost object store solution to its users.
Posted August 30, 2022
The developer behind the enterprise-scale, immutable archive solution that delivers breakthrough cost, margin, and sustainability benefits, Folio Photonics, is debuting breakthrough archival technology at low cost, high security, sustainability, and capacity. Folio's innovation, the multi-layer optical disc, redefines archival technology and leverages patented advancements in materials science for dynamic multi-layer read/write abilities. Its low-cost, paired with its high-capacity disk storage, presents a breakthrough both in materials science and data storage, according to the vendor.
Posted August 30, 2022
What is DevOps, and why is it so important for data management?As a relatively young concept, DevOps revolves around provisioning data quickly and synchronizing application data in database changes. It is easier said than done, however; challenges in data automation, slow components, application modernization, and team environments require solutions for optimal DevOps functionality.
Posted August 29, 2022
InfluxData, the enterprise behind time-series platform InfluxDB, is debuting new enhancements to its InfluxDB Cloud service. With new serverless capabilities, InfluxDB Cloud sees an acceleration of time-series data collection and processing, as well as an increase to storage capacity. The introduction of InfluxDB Native Collectors brings developers to the forefront with the ability to subscribe to, process, transform, and store real-time data from messaging and other public and private brokers and queues at the click of a button, according to the vendor. Native Collectors eliminate the need for additional software or new code while migrating data from third parties into the InfluxDB Cloud, increasing efficiency and decreasing resource waste.
Posted August 26, 2022
OpenText announced it has reached an agreement to acquire Micro Focus, implying an enterprise value of approximately $6.0 billion on a fully diluted basis. This merger would create one of the largest software and cloud businesses that enables digital transformations.
Posted August 26, 2022
Today's enterprises need to be more agile to improve their customer's experience, respond to changes quickly, and have the freedom to innovate. As part of their digital transformation journey in the cloud, these businesses need the ability to connect more devices to their applications, faster than ever—from smartphones to connected cars, from manufacturing plants to smart devices in our homes. Therefore, these applications need to scale quickly to potentially millions of users, have global availability, manage large volumes of data, and provide ultra-fast response times for customers.
Posted August 25, 2022
Cloudera, a hybrid data organization, is debuting its Cloudera Data Platform (CDP) One, an all-in-one data lakehouse SaaS, promising accelerated and accessible self-service analytics and exploratory data science on any data type. According to the company, CDP One delivers enterprise security and machine learning (ML) without requiring staff, resulting in lower TCO and reduced risk. CDP One is for customers who desire a low-code, self-service solution in conjunction with CDP One, which was not previously offered.
Posted August 25, 2022
Speed is at the forefront of technological innovation; users and customers of any online service have increasingly low tolerance for latency issues. Often, users will abandon a website if it takes too long to load—even if that load time is delayed by mere seconds. The natural response is to increase database performance; with those improvements, however, the costs quickly become detrimental.
Posted August 24, 2022
Deloitte announced a new asset roadmap and suite of cross-business integrated sustainability solution offerings, leveraging SAP technologies. Deloitte's new cross-business sustainability offerings and roadmap for SAP provide the knowledge and resources to help businesses remain resilient and move as fast as the speed of transformation.
Posted August 24, 2022
TDengine, an open-source data platform purpose-built for time-series data in IoT applications, is debuting TDengine 3.0, the latest update for the enterprise's time-series data management solution. As a database with caching, stream processing, and data subscription compiled into its open-source solution, TDengine 3.0 is now formatted with a cloud-native architecture for Kubernetes deployments, optimizing scale and simplicity of deployment and management. The release tackles major pain points for users with increasing amounts of data resulting from large-scale IoT deployments, according to the company.
Posted August 23, 2022
Pinecone, innovator of vector databases for building high-performance vector search applications, is debuting its latest enhancements to vector search that address ongoing challenges for the system. Issues such as determining type and size of index needed for data and performance needs, supporting high throughput, and scaling up indexes without interruption are no longer pain points for Pinecone users. These improvements take shape in features like vertical scaling, collections storage, and p2 pods for optimized vector search usage.
Posted August 23, 2022