REPORT ON BUSINESS

INTELLIGENCE

BY:

Ankit Karwa

( MANIT Bhopal)

1

Acknowledgements

It is indeed a matter of great honour for me to express my sincere gratitude towards Mr. Jayen Desai without whose continuous support it would not have been possible to complete my training uneventfully. Also I would like to humbly thank and express my gratitude towards Miss. Shivangi Jhavar whose incessant encouragement, kind cooperation, guidance and keen supervision at every step of my training period inspired me to pursue and complete the project with full enthusiasm and dedication.

My sincere thanks to the whole Information Technology team at Larsen and Toubro for patiently guiding me through my training period and without whose support this training would not been successfully completed.

2

TABLE OF CONTENTS

Acknowledgement………………………………………………………………………………..2

Abstract…………………………………………………………………………………………...4

Stored Procedure………………………………………………………………………………….4

Report Parameters…………………………………………………………………………………5

Introduction……………………………………………………………………………………….6

SQL Server Studio Management………………………………………………………………..6

SSRS………………………………………………………………………………………………7

Report Builder………………………………………………………………… ……………...7

SSIS……………………………………………………………………………………………….9

Business Intelligence Develeopment Studio…………………................................................10

Data Migration…………………………………………...............................................................12

Categories…………………………………………………………………………………….13

Application Migration………………………………………………………………………..14

Report……………………………………………………………………………………………15

Drill Down Report……………………………………………………………………………….16

Data Migration and transformation using SSIS…………………………………………………20

Web Form………………………………………………………………………………………..23

Conclusion……………………………………………………………………………………….25

Reference………………………………………………………………………………………..26

3

ABSTRACT

This project involves working on building reports of the company database of Larsen & Toubro in ERP LN equivalent to that of reports in BAAN using SSRS platform developed by Microsoft. Also the project involved working on building packages using SSIS by integrating data in a more organized and required way from BAAN to ERP LN company database server and creating web forms using C# based on .net framework provided by Microsoft on Visual Studio.

Stored Procedure A stored procedure is nothing more than prepared SQL code that you save so you can

reuse the code over and over again.

Instead of having to write that query each time you would save it as a stored procedure and then just call the stored procedure to execute the SQL code that you saved as part of the stored procedure.

In addition to running the same SQL code over and over again you also have the ability to pass parameters to the stored procedure, so depending on what the need is the stored procedure can act accordingly based on the parameter values that were passed.

Using this technique instead of using the “insert into” command repeatedly for a given table we can use a stored procedure and transfer the data from the ERP Baan database to the ERP LN database.

This will optimize the SQL query, not only it will be less time consuming but readability will be more.

4

Report Parameters

Report parameters enable you to control report data, connect related reports together, and vary report presentation.

Enable users to specify values to customize the data in a report. For example, provide two parameters for the start date and end date for sales data.

Enable users to specify values to help customize the appearance of a report. For example, provide a Boolean parameter to indicate whether to expand or collapse all nested row groups in a table.

Create a drop-down list of values to choose from, so that a user can only select a valid value.

Create a default value for each parameter, so that the report runs automatically on first view.

Create cascading values, so that the drop-down list for one parameter is the set of values that are valid based on the selection for a previous parameter. This enables you to successively filter parameter values from thousands of values to a manageable number.

Customize sets of parameters for multiple users. Create two linked reports based on a sales report on the report server. One linked report uses predefined parameter values for sales persons and the second linked report uses predefined parameter values for sales managers. Both reports use the same report definition.

Enable users to filter data from a shared dataset. When you add a shared dataset to a report, you cannot change the query. In the report, you can add a dataset filter that includes a reference to a report parameter that you create.

Report parameters while running a report in Report Builder

5

INTRODUCTION1) SQL Server Management Studio

SQL Server Management Studio is a software application first launched with the MicrosoftSQL Server 2005 that is used for configuring, managing, and administering all components within Microsoft SQL Server. The tool includes both script editors and graphical tools which work with objects and features of the server.

Central feature of SQL Server Management Studio is the Object Explorer, which allows the user to browse, select, and act upon any of the objects within the server.

It also has an "express" version that can be freely downloaded.

Starting from version 11, the application has been rewritten in WPF that is similar.

The SQL Server Management Studio presents a graphical interface for configuring, watching, and administering instances of SQL Server. It also uses you to deploy, monitor, and upgrade the data-tier components used by your user, such as databases and data warehouses. SQL Server Management Studio also provides Transact-SQL, MDX, DMX, and XML language editors for changing and debugging scripts.

This tutorial will help you understand to the presentation of information in Management Studio and how to take benefited the features. Note that this tutorial applies to the complete installation of Management Studio that is included with all editions of SQL Server except SQL Server Express. Functionality for basic installations of Management Studio and for Management Studio installations that ship with SQL Server Express is slightly different than what is presented in this tutorial.

6

2)SSRS

SQL Server Reporting Services (SSRS) is a server-based report generation software system from Microsoft. It is part of suite of Microsoft SQL Server services, including SSAS (SQL Server Analysis Services) and SSIS (SQL Server Integration Services). While SSAS enables users to construct special databases for fast analysis of very large amounts of data, and while SSIS enables users to integrate data from many sources outside Microsoft SQL Server, SSRS enables users to quickly and easily generate reports from Microsoft SQL Server databases.

SQL Server Reporting Services provides a full range of ready-to-use tools and services to help you create, deploy, and manage reports for your organization. Reporting Services includes programming features that enable you to extend and customize your reporting functionality.

Reporting Services is a server-based reporting platform that provides comprehensive reporting functionality for a variety of data sources.

Reporting Services includes a complete set of tools for you to create, manage, and deliver reports, and APIs that enable developers to integrate or extend data and report processing in custom applications.

 Reporting Services tools work within the Microsoft Visual Studio environment and are fully integrated with SQL Server tools and components.

With Reporting Services, you can create interactive, tabular, graphical, or free-form reports from relational, multidimensional, or XML-based data sources.

Reports can include rich data visualization, including charts, maps, and sparklines. You can publish reports, schedule report processing, or access reports on-demand. You can select from a variety of viewing formats, export reports to other applications such as Microsoft Excel, and subscribe to published reports.

The reports that you create can be viewed over a Web-based connection or as part of a Microsoft Windows application or SharePoint site. You can also create data alerts on reports published to a SharePoint site and receive email messages when report data changes

2.1)Report Builder

Report Builder provides a productive report-authoring environment for IT professionals and power users. It supports the full capabilities of SQL Server 2014 Reporting Services.

7

Report Builder is a free, stand-alone application that can be used by SQL Server developers and business users alike to create reports rich in data visualizations. It provides an Office-like interface that makes it easy to connect to a variety of data sources—such as SQL Server, SQL Azure, Oracle, and SAP NetWeaver BI—and to display the data from those sources in tables, charts, lists, gauges, and maps.

Bar and Pie Chart in Report Builder

8

3) SSIS

SQL Server Integration Services (SSIS) is a component of the Microsoft SQL Server database software that can be used to perform a broad range of data migration tasks.

SSIS is a platform for data integration and workflow applications. It features a fast and flexible data warehousing tool used for data extraction, transformation, and loading (ETL). The tool may also be used to automate maintenance of SQL Server databases and updates to multidimensional cube data.

First released with Microsoft SQL Server 2005, SSIS replaced Data Transformation Services, which had been a feature of SQL Server since Version 7.0. Unlike DTS, which was included in all versions, SSIS is only available in the "Standard", "Business Intelligence" and "Enterprise" editions.[1]

SQL Server Integration Services (SSIS) is a tool that we use to perform ETL operations; i.e. extract, transform and load data.  While ETL processing is common in data warehousing (DW) applications, SSIS is by no means limited to just DW; e.g. when you create a Maintenance Plan using SQL Server Management Studio (SSMS) an SSIS package is created.  At a high level, SSIS provides the ability to:

retrieve data from just about any source perform various transformations on the data; e.g. convert from one type to another,

convert to uppercase or lowercase, perform calculations, etc. load data into just about any source define a workflow

9

3.1)BUSINESS INTELLIGENCE DEVELOPMENT STUDIO

Business Intelligence Development Studio (BIDS) is the former IDE from Microsoft, and was used to develop data analysis and Business Intelligence solutions utilizing theMicrosoft SQL Server Analysis Services, Reporting Services and Integration Services. It is based on the Microsoft Visual Studio development environment, but customized with the SQL Server services-specific extensions and project types, including tools, controls and projects for reports, ETL dataflows, OLAP cubes and data mining structure.

BIDS functionality can be augmented with BIDS Helper, a Visual Studio add-in with features that extended and enhance business intelligence development functionality in SQL Server 2005, 2008, and 2008 R2 BI Development Studio (BIDS) and SQL Server 2012 SQL Server Data Tools (SSDT). BIDS Helper is hosted on Microsoft's open source project hosting website CodePlex.[1]

Business Intelligence Markup Language (Biml) can be used in BIDS to create end-to-end BI solutions by translating Biml metadata into SQL Server Integration Services (SSIS) and SQL Server Analysis Services (SSAS) assets for the Microsoft SQL Server platform.

An Analysis Services Project in BIDS

10

Data Migration using BIDS

11

4)WHAT IS DATA MIGRATION

Data migration is the process of transferring data between storage types, formats, or computer systems. It is a key consideration for any system implementation, upgrade, and consolidation. Data migration is process to transfer data from one table to other.Data migration is usually performed programmatically to achieve an automated migrationor freeing up human resources from tedious tasks. Data transfer(migration) occurs for a variety of reasons, including: Server or storage equipment replacements or improve; Website consolidation; Server maintenance; and Data center relocation.

To achieve an successful data migration procedure, data on the old system (table) is mapped to the new system (table) providing a design for data extraction and data loading. The design relates old data formats to the new system's formats and requirements the format of data should be similar. First match the field present in table. Programmatic data migration may involve many phases but it minimally includes data extraction where data is read from the old system and data loading where data is written to the new system or transfer the data from old table to new table.

If a decision has been made to provide a set input file specification for loading data onto the target system or transfer the data from source table to destination table this allows a pre-load 'data validation' step to be put in place, interrupting the standard E(T)L process. Such a data validation process can be designed to interrogate the data to be transferred, to ensure that it meets the predefined criteria of the target environment, and the input file specification or An alternative strategy is to have on-the-fly data validation occurring at the point of loading, which can be designed to report on load rejection errors as the load progresses. However, in the event that the extracted and transformed data elements are highly 'integrated' with one another, and the presence of all extracted data in the target system is essential to system functionality, this strategy can have detrimental, and not easily quantifiable good effects.

After loading into the new system, results are subjected to data verification to determine whether data was accurately translated, is complete, and supports processes in the new system or new table. Both system support the data. During verification, there may be a need for a parallel run of both systems to identify areas of disparity and forestall erroneous data loss.

12

Automated and manual data cleaning is commonly performed in migration to improve data quality, eliminate redundant or obsolete information, and match the requirements of the new system.

4.1) Categories

Data is stored on various media in files or databases, and is generated and consumed by software applications which in turn support processes. The need to transfer and convert data can be driven by multiple business requirements and the approach taken to the migration depends on those requirements or data. There are many type of migration categories are proposed on this basis.

4.1.2) Storage migration

A business may choose to rationalize the physical media to take advantage of more efficient storage technologies. The result in having to move physical blocks of data from one tape or disk to another, often using virtualization techniques. The data format(row contain) and content itself will not usually be changed in the process and can normally be achieved with minimal or no impact to the layers above.

13

4.1.3) Application migration

Changing application vendor – for instance a new CRM or ERP platform – will inevitably merge substantial transformation as almost every application or suite operates on its own specific data model. Further, to allow the application to be sold to the widest possible market, commercial off-the-shelf packages are generally configured for each customer using metadata. Application programming interfaces (APIs) are supplied to protect the integrity of the data they have to handle. Use of the API is normally a condition of the software warranty, although a waiver may be allowed if the vendor's own or certified partner professional services and all tools are used.

4.1.3) Business process migration

Business processes operate through a combination application systems actions, often orchestrated by business process management tools. When these change they can require the transfer of data from one store, database or application to another to reflect the changes to the organization and knowledge about customers, products and operations. Examples of such migration drivers are mergers and acquisitions, business optimization and reorganization to attack new markets or respond to competitive threat.

The first two part of migration are usually routine operational activities that the IT department takes care of without the involvement of the rest of the business. The last two categories directly affect the operational users of processes and applications, are necessarily hard, and delivering them without significant business downtime can be challenging. A highly adaptive approach, concurrent synchronization, a business-oriented audit capability and clear visibility of the migration for stakeholders are likely to be key requirements in such migrations.

14

5) REPORT

BUILDING REPORTS USING SSRS

SEAM AND STAGE CLEARANCE ANALYSIS REPORT

This report which was in ERP BAAN earlier is converted into that of ERP LN under this project using MS SQL Studio and Report Builder 3.0

Firstly, the queries were extracted from the BAAN report in Cognos and using MS SQL Server Studio, the queries were optimized and the BAAN tables were replaced with their corresponding LN table counterparts.

The queries were made as a dataset in the Report Builder under a data source of the company database and the corresponding columns were extracted from the tables.

A matrix was created manually with rows and column grouping done so as to represent data in a way the earlier BAAN report was.

Using the dataset, the columns of the database tables were placed in the matrix columns so as to represent data in them in a logical way also the column properties like background colour, font properties were changed.

New with the need of adding a parameter, in the main dataset query under the where clause parameters in their proper syntax (e.g. where t_clnt in (@parameter1)) were added so as to filter out the data according to the columns like in the above example t_clnt .

Parameters properties were also changed to give available values so that the user can select from them In order to filter out data according to need and also default values can be set.

Never datasets were added in order to filter out the data based on more parameters under the columns like Start_date and End_date.

Parameters were all defined in the syntax stated above in the main query. Parameters were cascaded such that one parameter may filter out the data from which other parameter may choose to filter even furthermore.

Lastly, the report was tested according to needs.

15

5.1) DRILL DOWN REPORTYou can organize data in a variety of ways to show the relationship of the general to the detailed. You can put all the data in the report, but set it to be hidden until a user clicks to reveal details; this is a drilldown action. You can display the data in a data region, such as a table or chart, which is nested inside another data region, such as a table or matrix. You can display the data in a subreport that is completely contained within a main report. Or, you can put the detail data in drillthrough reports, separate reports that are displayed when a user clicks a link.

16

A Drill Down report

Datasets They UseSubreports and drillthrough reports can use the same dataset at the main report, or they can use a different one. Nested data regions use the same dataset.Retrieving DataSubreports and nested data regions retrieve data at the same time as the main report. Drillthrough reports do not. Each drillthrough report retrieves data when a user clicks each

17

link. This is significant if the data for the main report and the subordinate report must be retrieved at the same time.Processing and RenderingA subreport is processed as part of the main report. For example, if a subreport that displays order detail information is added to a table cell in the detail row, the subreport is processed once per row of the table and rendered as part of the main report. A drillthrough report is only processed and rendered when the user clicks the drillthrough link in the summary main report.PerformanceWhen deciding which to use, consider using a data region instead a subreport, particularly if the subreport is not used by multiple reports. Because the report server processes each instance of a subreport as a separate report, performance can be impacted. Data regions provide much of the same functionality and flexibility as subreports, but with better performance. Drillthrough reports have better performance than subreports, too, because they don't retrieve all the data at the same time as the main report.Use of ParametersDrillthrough reports and subreports typically have report parameters that specify which report data to display. For example, when you click a sales order number in a main report, a drillthrough report opens, which accepts the sales order number as a parameter, and then displays all the data for that sales order. When you create the link in the main report, you specify values to pass as parameters to the drillthrough report.To create a drillthrough report or subreport, you must design the target drillthrough report or subreport first and then create a drillthrough action or add the reference to the main report.ReusabilitySubreports and drillthrough reports are separate reports. Thus, they can be used in a number of reports, or displayed as standalone reports. Nested data regions are not reusable. You cannot save them as report parts because they are nested in a data region. You can save the data region that contains them as a report part, but not the nested data region.LocationSubreports and drillthrough reports are both separate reports, so they're stored external to the main report. Subreports can be on the same or a different report server, but drillthrough reports must be on the same report server. Nested data regions are part of the main report.DisplaySubreports and nested data regions are displayed in the main report. Drillthrough reports are displayed on their own.

How A Drill Down Report is made?

ON the Actions feature in the Text Box Property tab of the cell of the report whose drill down report is to be made, path of the report that should open on clicking is given such that on clicking the particular cell that report will open.

The report Seam Clearance Report was made as a Drill-down report under this project.

18

19

6) DATA MIGRATION DONE WITH TRANSFORMATION USING SSIS

In SSIS, in order to migrate data from one source to other, let’s say Excel to SQL database alongWith data transformation i.e. adding new columns or replacing current columns with others, conditional transforms etc package is created.

20

In order to load the data from one source and store it in other source, connection managers are set up in which connection string for the database in SQL or path link for file In Excel is provided in order to establish connection.

Next a Data Flow Task from the toolbox is dragged and dropped onto the workspace and is double clicked on. ( Based on requirements Email can also be sent by choosing Sent Email task from the toolbox).

Inside the Data Flow Task, a new window opens which is the actual workspace where data migration from one source to other will occur.

The source and the destination are set up (dragged and dropped from the toolbox) in the workspace .

Inside the Source ( let’s say Excel Source) properties, the Connection Manager ( in this case Excel ) established earlier is chosen and the file is chosen from which the data will be Extracted.

The columns will automatically be derived and the developer has the liberty to include any number of columns from the available list as per the requirement.

In order for transformation, based on what kind of transformation is required, a required transformation is dragged an dropped from the toolbox ( in this case a new column is added so derived transformation is used) and connected using green arrow under the source and in its properties window, based on the requirements new columns can be added or derived from the pre existing columns based on the defined operations.

Again the green arrow under the transformation icon is connected to destination ( in this case, OLE DB destination) , with this, in the properties window, the required database table or sql query is provided where the data is to be loaded and the data columns are matched according from the derived to destination so proper data flow can occur.

Lastly the whole package is debugged and the green icons suggest that the debugging is successful and the data flow occurred successfully.NOTE: Many transformations can be used simultaneously at once in a package.

In case of an error, icons turn red and the debugger returns list of errors.How to solve the error :

If error is belonging to ASCII file than first check the ASCII file filed if ASCII filed is not in correct order than first we arrange the ASCII file filed and reload the file one more time.

If error is belong to date format than first we check what type of date format present in Ln side than we change according to Baan side.

If error is belong to .char than we change the format of char.

For transferring an Excel file data into SQL database table:

1. A data flow task ( discussed earlier) is added.2. Inside it, Connection Managers for Excel and OLE DB ( for SQL Server Studio) are

established.

21

3. A Excel Source is chosen from the toolbox and a OLE DB destination is also chosen.4. Inside Excel Source , Connection Manager is connected to it, and the data from the

required file is extracted.5. In order to convert datatype of the data in Excel to Compatible datatype in SQL , a Data

Conversion transformation is dragged and dropped and connected to the green arrow emerging out from Excel source.

6. The columns whose datatype is to be changed is chosen in Data Converter and required conversion type is provided.

7. Finally the green arrow emerging from Data Convertor is connected to OLE DB destination in which the Connection Manager is connected and corresponding database into which data is to be loaded is extracted. Also data is mapped from source to destination columns.

8. The whole package is debugged.

22

7) WEB FORM CREATION USING C#

A Web Form created using Visual Studio

Web Forms is one of the 3 programming models for creating ASP.NET web sites and web applications.

The other two programming models are Web Pages and MVC (Model, View, Controller).

Web Forms is the oldest ASP.NET programming model, with event driven web pages written as a combination of HTML, server controls, and server code.

23

Web Forms are compiled and executed on the server, which generates the HTML that displays the web pages.

Web Forms comes with hundreds of different web controls and web components to build user-driven web sites with data access.

ASP.NET is a development framework for building web pages and web sites with HTML, CSS, JavaScript and server scripting.

Web forms are easy to create by simply using the drag and drop feature in which buttons are dragged and dropped onto the required place and just by double clicking on them, object is formed where the user has to encode in C# for the function that button will do.

Simultaneously HTML code will be generated automatically.

A simple Registration form was created using Visual Studio in C# coding.

24

Conclusion

The Technical internship has a very vital role to perform. The practical knowledge is as important as the theoretical knowledge in order to work in an organization.Microsoft is one of the most prominent software and the project involves various concepts based on Software and programming as well as management aspects.So, by this we can learn effectively the aspects of computer science and the practical working of the company. This project has Data Migration. Thus, at the end of 3 weeks with Larsen and Toubro, I’ve learned about Microsoft SQL Server Studio, Report Builder, Business Intelligence Development Studio, Working on Workflow creation of form. It will also involve working on ASP.NET ( Visual Studio).This internship has given me an opportunity to see how organisation works and the factors which contribute to its efficient functioning, thus, helping me associate my theoretical knowledge with the practical aspects.

25

REFRENCE :(initial list of Bibliographic and internet materials that would be used to complete the project.)

http://en.wikipedia.org http://www.mssqltips.com/sqlservertutorial/160/sql-server-stored-procedure/ http://www.w3schools.com/sql/default.asp?

PHPSESSID=300ae3404d5fa2612f238abeebb8869c http://geekswithblogs.net/dotNETvinz/archive/2009/04/30/creating-a-simple-

registration-form-in-asp.net.aspx https://www.simple-talk.com/sql/reporting-services/report-builder-3.0-creating-a-

basic-report/

26