Showing posts with label big-data. Show all posts
Showing posts with label big-data. Show all posts

Wednesday, 4 September 2019

Association Analysis Algorithms Implementation using HANA ML Python APIs.

Let’s Start –

Here is small list & introduction of the methods which I will be implementing one by one.

Introduction and algorithm description


I have used Jupyter Notebook which uses the real time itemset dataset to demonstrate the association rule mining algorithms below which are provided by in hana_ml package.

Friday, 21 June 2019

Machine Learning with SAP HANA & R – Evaluate the Business Value

In this blog, I will show how to evaluate the business value from a machine learning model built in SAP HANA using R.

Combining SAP HANA & R allows the data scientist or advanced business analyst to leverage the power of SAP HANA and at the same time get the vast functionality from the use of R Packages. The main benefit with an approach of using SAP HANA in combination with R is that it allows you to utilize the power of SAP HANA both in terms of scalability and performance through R scripting. In a nutshell, there is no movement of training data from SAP HANA to the R server/client and the training of machine learning models is performed exactly the same place as where the data resides. In short: algorithms and data are on the same in-memory SAP HANA server.

Wednesday, 20 September 2017

Bring the Power of SAP HANA to SAP (Sybase) Adaptive Server Enterprise Applications

Legacy Adaptive Server customers totally understand and appreciate the technical and economic benefits of a reporting database. Using replication server, many Adaptive Server customers are replicating to an Adaptive server reporting instance and running their reports against the reporting copy. Some are replicating into analytical engines like SAP IQ or third party databases like Netezza. But this requires rethinking and re-writing their Transact-SQL reporting applications and procedures.

Friday, 7 October 2016

What is VORA and How it helps to Bridge the gap between Enterprise data and Big Data

Before getting into the Topic of VORA first we lets try to understand what is Enterprise data, Big Data, HADOOP, SPARK.

What is Enterprise Data – Data that comes from Day today business transactions eg. Sales order, Purchase Order, etc.

What is Big Data – Data that comes from information-sensing mobile devices, aerial (remote sensing), software logs, cameras, microphones, radio-frequency identification (RFID) readers and wireless sensor networks, Social Media and Archived Data.

Monday, 19 September 2016

Optimising HANA Query push-down from Apache Spark

As you start using it with larger Tables or Views in HANA, you may notice that the query that is pushed down into HANA is not optimised efficiently. SUM & GROUP BY Clauses are NOT pushed down into HANA,  this may cause a large granular result set to be move across the network, to only be Aggregated in Spark.  That is certainly a waste of HANA's powerful query engine.
In this blog I will demonstrate the problem and show several ways to help get around it, using Apache Spark.

Using the same dataset from the earlier blog  we can see how more complex Spark SQL ( executing against a test table in HANA - "RDATA") is actually pushed down into HANA.

Tuesday, 17 May 2016

LEARN WITH US : S/4 HANA Analytics!!

What it is?

S/4 HANA stands for Simple 4th Generation Business suite solutions from SAP which will run on SAP HANA. SAP HANA is one of the preferred product among the companies seeking for an optimized enterprise solution because the product has come a long way from its previous predecessors which had its transaction processing and analytical processing in different platforms, that meant more time on data output and decision making.

It is very well known as The Next Generation Business Suite and it is greatest innovation since R3 and ERP from the SAP world. It unites the software and people to build businesses to run on real-time, networked and in simple way. It has got built-in analytics for hybrid transactional and analytical applications.

Tuesday, 5 April 2016

Parallelization options with the SAP HANA and R-Integration

Why is parallelization relevant?

The R-Integration with SAP HANA aims at leveraging R’s rich set of powerful statistical, data mining capabilities, as well as its fast, high-level and built-in convenience operations for data manipulation (eg. Matrix multiplication, data sub setting etc.) in the context of a SAP HANA-based application. To benefit from the power of R, the R-integration framework requires a setup with two separate hosts for SAP HANA and the R/Rserve environment. A brief summary of how R processing from a SAP HANA application works is described in the following:

  • SAP HANA triggers the creation of a dedicated R-process on the R-host machine, then
  • R-code plus data (accessible from SAP HANA) are transferred via TCP/IP to the spawned R-process.
  • Some computational tasks take place within the R-process, and
  • the results are sent back from R to SAP HANA for consumption and further processing.

Monday, 7 March 2016

Using Multiple Values in Input parameter for filtering in Graphical Calculation View

In the previous blog SAP HANA: Handling Dynamic Select Column List and Multiple values in input parameter have shown on how to select multiple values for filtration using "Replace" function in procedure.

In that document, we went to procedure approach, since the user needs the dynamic output based on input conditions.

But if the output is static column list, you wouldn't want to use procedure, so in this blog will be explaining on how to achieve the same functionality of handling multiple values filter condition on a graphical calculation view using "Projection".

Problem Description:

Giving the flexibility of choosing the values he wishes to see in the report and then pushing the filtration logic to the lowest level possible.

Saturday, 27 February 2016

SAP HANA: Handling Dynamic Select Column List and Multiple values in input parameter

In this document we will be discussing on how to handle multiple values passed in to filter condition using “REPLACE” Function in procedure and also Dynamic SQL using Execute Immediate.

Note: We followed this approach since our reporting tool is HTML5 web dashboards and we cannot consume Variables with "Multiple Values" for the same.

A) Problem Description:

--> How to handle multiple values in filter condition ?

Example:

If we have “Region” as a filtering criterion and we have 3 Regions namely: AMR, APAC and EMEA and the user want the flexibility to select the list of regions for which he wants to analyze the data.