Wednesday, 2 October 2019

Integrating Amazon Simple Queue Service (SQS) with SAP HANA

Introduction


Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. To integrate SQS with a HANA database, Advantco developed an adapter SQS for SAP Smart Data Integration(SDI). The adapter enables bi-directional data exchanges between HANA databases and AWS SQS. This blog details the steps required to replicate data from a SQS queue to a HANA real table.

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

Steps to configure and use the Advantco SQS adapter for SDI.

Deploy the Advantco adapter SQS adapter for SDI, this is done on the DP Agent system.

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

Define the structure of the message in the SQS queue. This structure will define the scheme for the table in HANA.

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

Create Remote Source, the source should refer to the DP agent where the adapter was deployed.

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

Define the replication task to create virtual and real tables. The replication behavior can be initial and/or realtime load.

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

Query the virtual and real tables. The virtual is a realtime connection to the SQS queue, querying the virtual does not remove the messages from the SQS queue. The real table contains the polled data from the SQS queue, these messages are no longer available in the queue.

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

Insert into the virtual table result into publishing a message to the SQS queue.

SAP HANA Learning, SAP HANA Tutorials and Materials, SAP HANA Certifications, SAP HANA Online Exam

No comments:

Post a Comment