SAP Datasphere – SAP Data Provisioning Agent Upgrade

Introduction:

This blog is about updating the SAP Data Provisioning agent which is also known as “DP Agent” (On windows). The Data Provisioning Agent provides secure connectivity between the SAP HANA database and you’re on premise, adapter-based sources. The DP Agent control all SAP HANA smart data integration (SDI) Adapters and connections to HANA database. It acts as the communication interface between HANA and the Adapter.

SAP Datasphere allows you to use SAP HANA smart data integration (SDI) and its Data Provisioning Agent to enable on-premise connections. To do this, you first have to download and install the SDI Data Provisioning agent to a network location from which it can establish HTTPS connections to SAP HANA on Cloud.

Keep-Data-Clean: Practical approaches to keep your core (S/4 HANA) system clean

“Every company will become a technology company, and every company will become a data

company” – Steve Brown ‘The Innovation Ultimatum’

In SAP world, almost every company intended to use S/4HANA as their digital core.

But to run any sort of business, many companies also need various other SAP and non-SAP

systems/SaaS solutions. (On top of S/4 HANA). Like:

– PIM to manage all categories of products,

– WebShop to handle direct customer orders,

– EWM (advanced) to manage a warehouse,

– CRM to manage customer relations,

– PSP (payment service provider) for digital payments,

– SAP Ariba for spend management,

– Success factors for human capital management,

Etc… just to give some names, there could be many possibilities.

Analyze SAP S/4HANA On-Premises Data using SAP Analytics Cloud Powered by SAP Data Warehouse Cloud

This simple blog post helps you get an understanding of how data from an SAP S/4HANA on-premises system can be Analysed using SAP Analytics Cloud which is connected using Data Warehouse Cloud in SAP Business Technology Platform (BTP).

This blog post covers –

◉ Connectivity of SAP S/4HANA On-premise system to SAP Data Warehouse Cloud.

◉ Creation of a View using SAP Data Warehouse Cloud Data Builder.

◉ Consume the View in SAP Analytics Cloud and create a story.

Data migration from SAP S/4HANA Cloud and SAP HANA Smart Data Integration

Background

This blog post is aimed to share my experiences working on data migration activities migrating data from a SAP S/4HANA Cloud system to a SP S/4HANA On-Premise system and the usage of SAP Migration Cockpit together with SAP HANA Smart Data Integration (SAP HANA SDI) helping on this purpose.

There are a few challenges on this scenario for data migration:

◉ Extract data from SAP S/4HANA Cloud

◉ Transform the data extracted (in files) to use as a source data for Migration Cockpit

Manage XS Advanced via SQL

Introduction

The main tools for XS Advanced administration are the XS Command-Line Interface and the XS Advanced Cockpit.

For both of them, the prerequisites are to have an XS Advanced user with required role collections and also to be member of the organization/space you want to manage.

If you are using XSA only in the context of Data modeling (HDI Advanced Model) via WebIDE for HANA, you may face the situation that developers have XS Advanced users in development system but only basic database users in quality and production systems. For security reason, you may not want to provide them access to XSA Cockpit in Quality and Production systems.

HANA Reptasks: A Technical Perspective

This blog will cover the technical setup required to create HANA reptasks in Business Application Studio. In this scenario, we will be connecting to an on-prem S/4HANA instance and replicating the data into a HANA Cloud Service instance in Cloud Foundry.

Prerequisites:

◉ DPAgent installed, connected, and configured.

    ◉ There are several guides and blogs already available for this, and the setup is straightforward. Download the latest version from the SWDC by searching “HANA DP AGENT” in the downloads bar.

◉ HANA Cloud Service instance created.

Near real time Data Replication from Salesforce to SAP HANA using the Advantco Salesforce adapter for SDI

Introduction

Salesforce provides APIs that enable external applications to receive events in near real time mode. In this blog, we provide a detailed configuration steps for two of these options: Platform Event and Change Data Capture (CDC). Platform Event is an excellent option when data from multiple objects are required as in the case of combining data from Opportunity with details from the Account object. Change Data Capture (CDC) provides a quick and configurable option to publish data of a specific object like Account or Contact.

The solution we describe here is based on SAP Smart Data Integration (SDI) tools which provide features to support data replication from external resources to SAP HANA. The two most important components in this context are the Data Provisioning Server, which is a native SAP HANA process, and the Data Provisioning Agent, which is a container running outside the HANA environment. The Advantco Salesforce adapter is deployed on the Data Provisioning Agent host and can be configured from the HANA environment duration the creation of a remote source. The remote source is the connection from SAP HANA to the Salesforce instance.

Using SDI FileAdapter to write to Azure file share

In this blog we will create an Azure file share and use it as a destination for SAP SDI FileAdapter.

Prerequisites

1. Azure Account

2. SAP HANA Data Provisioning Agent server enabled

3. SAP HANA Data Provisioning Agent installed

Let’s start by creating the Azure file share. Login to the Azure portal and create a premium storage account  as depicted in the below screenshot

Data Federation between SAP HANA Cloud and Amazon S3 to Blend Business Data with External Data

We will talk about how to perform data federation between SAP HANA Cloud and Amazon S3 bucket so that we can incorporate external data into our business data while keeping both data sitting in their own places. We will be focusing a bit more on the integration part where we need to install and run SAP Data Provisioning Agent on Linux environment. The architecture for the result looks like the following: 

Please note that our demo case is using EC2 instance as host for our DPAgent and storage gateway service as a virtual storage mounted to EC2 instance. Your own case might be a bit different, for instance, you have your own on-premises system to host DPAgent. (DPAgent, also named Data Provisioning Agent which hosts all SAP HANA smart data integration Adapters and acts as the communication interface between HANA, on which the SAP Data Warehouse Cloud is built, and the Adapter.) 

Set up real-time replication tasks with the SAP Web IDE and SAP Smart Data Integration

The SAP Web IDE provides so-called replication tasks to set up real-time replication. It provides a graphical UI to browse tables in your connected source systems, create virtual tables, create subscriptions for real-time replication, create data load partitioning strategies, and more. The replication tasks in Web IDE are part of the SAP Smart Data Integration (SDI) toolset, which comes integrated with the SAP HANA platform, both on-premise and in the cloud.

Set up real-time trigger-based replication from MSSQL to SAP HANA Cloud (or on-prem) using SAP Smart Data Integration (SDI)

In this blog I describe how to set up real-time replication, and in this case for a Microsoft SQL, or MSSQL, database. The tool of choice is SAP Smart Data Integration (SDI), which comes with SAP HANA Cloud or the on-prem version.

The whole process is also documented in the readme file of this Github repo. That repo also contains the Web IDE project to built on top of the replication setup. How you can use the Web IDE to create real-time replication tasks, I’ll describe as a follow-up blog.

Data Provisioning using OracleLogreaderAdapter and CamelJDBCAdapter

What is DATA Provisioning?

DATA Provisioning is a process of creating, preparing, and enabling a network to provide data to its user. Data needs to be loaded to SAP HANA before data reaches to the user via a front-end tool.

SAP HANA Smart Data Integration

SAP HANA smart data integration loads data, in batch or real-time, into SAP HANA (on premise or in the cloud) from a variety of sources using pre-built and custom adapters.

SDI – DP Agent and Remote Source Configuration in HANA to Read Data from S/4HANA

HANA Smart Data Integration (SDI) Introduction:

SDI is HANA database native technology to support all styles of data integration. It can be used for data federation (Smart Data Access), real-time data replication and to apply complex transformations on the data.

SDI is available on SAP Cloud Platform and every HANA database since HANA SPS09.

Small Hands-on SAP HANA Application Lifecycle Management

In this article you will see how to transport native HANA objects between systems.

HANA Application Lifecycle Management (HALM) is easy to use part of XS services (SAP HANA Extended Application Services). It can be configured based on your preferences. The user should have a particular roles assignment.

First of all, we should have objects which we are going to transport from our source HANA system to the target. For this particular reason I will create a sub package Test_HALM in our main Test package.

Access SAP ERP data from SAP HANA through SDI ABAP Adapter

Do you want to use data residing in SAP ERP for analytics or machine learning?

SAP offers several options to extract data residing in ABAP-based systems. We will explore one of these options in this blog : SAP HANA smart data integration (SDI). SDI provides tools to access source data and provision, replicate, and transform that data in SAP HANA on-premise or in the cloud. You can efficiently connect to many sources to provision and cleanse data for loading into SAP HANA. For supported systems, you can also write back from HANA to the original source.

In this blog, we will set up the ABAP Adapter for a real time data replication from SAP ERP to SAP HANA as a Service.

How to replicate STXL table (INDX-like) using SDI

The Problem

The purpose of this document is to describe our approach to replicate table STXL from SAP ECC to HANA DB using SAP HANA SDI. Replicating STXL is challenging because it is an INDX-like table. Its content must be parsed before being saved into HANA DB.

In our previous projects, SAP SLT was the tool used to perform the replication. There is good documentation on SCN explaining how to configure SLT to replicate INDX-like tables. However, we could not find similar materials when SAP HANA SDI is used.

Replicating Data from Oracle to HANA using SAP HANA Web IDE SDI

Overview

SAP Smart Data Integration provides real time, high speed data provisioning, bulk data movement, and federation. Replication task or flowgraph lets you set up batch or real-time data replication and transformation scenarios in an easy-to-use web application. Data Provisioning Agent hosts data provisioning adapters, enables data federation, replication, and transformation scenarios for on-premise or in-cloud deployments. Monitors for Data Provisioning Agents, remote subscriptions, and data loads are accessible from the SAP HANA cockpit.

SAP HANA Data Strategy: HANA Data Modeling a Detailed Overview

Why talk about HANA Data Modeling?

HANA data modeling is what drives real-time analytics while lowering the total cost of ownership (TCO) and time to deliver (TDL) business insights using SAP HANA digital business platform.

SAP HANA Data Strategy

Overview

As database and business analytics professionals we have always struggled with implementing the business’s conceptual data model and analytics strategy given the limitations of traditional database technologies. We understand the data and the many attributes that allow us to view the data from many angles, but the traditional database technologies did not allow us to create very wide tables and limited the number of ways we could access the data. These limitations then drove the models to have multiple copies of data summarized for specific use cases. All of these traditional database limitations lead us to create very complex models for solving quite straight forward problems. The complexity of the data models then created limited flexibility and tremendous latency.

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Introduction

Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. To integrate SQS with a HANA database, Advantco developed an adapter SQS for SAP Smart Data Integration(SDI). The adapter enables bi-directional data exchanges between HANA databases and AWS SQS. This blog details the steps required to replicate data from a SQS queue to a HANA real table.