Denodo is a data virtualization platform that allows organizations to integrate, manage, and deliver data in real-time without physically moving or replicating it. It provides a unified data view across multiple sources such as databases, cloud systems, big data platforms, and APIs.
2. What is Data Virtualization?Data virtualization is a logical data integration technique that lets users access and query data from multiple systems as if it resides in one place, without copying or transferring it. It improves agility and reduces data latency.
| Denodo (Virtualization) | ETL Tools (Extraction & Loading) |
|---|---|
| Does not move data | Moves and stores data |
| Real-time data access | Batch data access |
| Faster implementation | Time-consuming |
| Minimal storage needs | Requires additional storage |
A Virtual Database is a logical database created in Denodo to organize views, configure roles, and maintain security policies. It acts as a workspace for data modeling and virtualization.
VDP (Virtual DataPort) is the core engine of Denodo that handles:
It is a metadata, search, and annotation tool that allows users to discover, understand, and tag datasets for self-service analytics.
Caching stores query results temporarily so frequently accessed data can be retrieved faster. It improves performance and reduces load on source systems.
| Partial Cache | Full Cache |
|---|---|
| Caches only query results | Caches complete view data |
| Used for dynamic sources | Used for relatively static data |
| Less resource consumption | More storage needed |
Query pushdown means Denodo delegates query execution to the source system whenever possible to reduce processing at the virtualization layer and improve performance.
Denodo Scheduler is used for automation tasks like:
A Wrapper in Denodo is a component that connects Denodo to external data sources and translates Denodo’s logical queries into the source system’s native query language. It ensures seamless communication between Denodo and systems like databases, APIs, or files. Wrappers handle protocol, query syntax, and execution differences automatically. In simple terms, they act as query translators between Denodo and the underlying data sources.
Data Masking in Denodo is the process of hiding or obfuscating sensitive data such as personal or financial information. It allows developers and analysts to work with realistic datasets without exposing confidential details. This is achieved using masking functions like substring, encryption, nulling, or randomization.
Incremental cache refresh in Denodo is handled by configuring Custom Cache Invalidation Policies that refresh only the updated records instead of the full dataset. This is often achieved using timestamp or primary key-based filters in cache queries. The Denodo Scheduler is used to automate these incremental cache refresh jobs.
Denodo REST Web Service allows you to expose Denodo views as RESTful APIs so external applications can access virtualized data in real-time. It supports JSON and XML formats for flexible data consumption. This helps integrate Denodo data easily with web apps, BI tools, and third-party systems.
Interface Views in Denodo are final output views designed for consumption by end-users, BI tools, or APIs. They act as a clean, standardized layer that hides internal data complexity and transformations.These views help maintain governance, consistency, and simplified data access across systems.
Denodo Aggregation Awareness is a feature that allows Denodo to automatically choose the most optimized aggregated dataset when executing queries. It helps improve performance by using pre-aggregated or summary views instead of detailed data when appropriate. This reduces processing time and speeds up reporting and analytics workloads.
Custom Functions in Denodo are user-defined Java functions that extend Denodo’s built-in transformation capabilities. They are created when default functions do not meet specific business logic or calculation needs. Once deployed, they can be used directly in views just like standard Denodo functions.
| Denodo Control Center | VDP Admin Tool |
|---|---|
| Starts/stops Denodo services | Used for development/configuration |
| System-level operations | View & query management |
| User and cluster admin | Data modeling & access control |