Category Archives: Data Platform

SQL Server System Dynamic Management Views

System Dynamic Management Views https://docs.microsoft.com/en-us/sql/relational-databases/system-dynamic-management-views/system-dynamic-management-views?view=sql-server-ver15?WT.mc_id=DP-MVP-36769 Returns size and fragmentation information for the data and indexes of the specified table or view in SQL Server, sys.dm_db_index_physical_stats. https://docs.microsoft.com/en-us/sql/relational-databases/system-dynamic-management-views/sys-dm-db-index-physical-stats-transact-sql?view=sql-server-ver15?WT.mc_id=DP-MVP-36769 Returns information about all the waits encountered by threads that executed, sys.dm_os_wait_stats. https://docs.microsoft.com/en-us/sql/relational-databases/system-dynamic-management-views/sys-dm-os-wait-stats-transact-sql?view=sql-server-ver15?WT.mc_id=DP-MVP-36769 Returns … Continue reading

Posted in .Net, Cloud, Community, Computers and Internet, Data Platform | Tagged | Leave a comment

Azure SQL Database

You can get started with SQL Azure here. Azure SQL Database documentation https://docs.microsoft.com/en-us/azure/sql-database/?WT.mc_id=DP-MVP-36769 What is Azure SQL Data Warehouse? https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-overview-what-is/?WT.mc_id=DP-MVP-36769 Cheat sheet for Azure SQL Data Warehouse https://docs.microsoft.com/en-us/azure/sql-data-warehouse/cheat-sheet/?WT.mc_id=DP-MVP-36769

Posted in .Net, Cloud, Community, Computers and Internet, Data Platform | Tagged | Leave a comment

using Microsoft.Office.Interop.Excel object cannot be deleted

This post shows you how to dispose and get rid the object when you exit the application. Previously in https://chanmingman.wordpress.com/2017/11/06/convert-excel-sheet-to-csv-file/. The application exited but the Excel object still exist. You have to implement IDisposable to get rid of the unmanaged … Continue reading

Posted in .Net, Cloud, Community, Computers and Internet, Data Platform | Tagged | Leave a comment

SSIS Remove Time from Datatime

This blog shows you how to remove time from SQL Server source with Datetime column. The pre-requisite is you need to have basic knowledge on SSIS. You can see from the picture below. I have a column from SQL Server … Continue reading

Posted in .Net, Cloud, Community, Computers and Internet, Data Platform | Tagged | Leave a comment

SSIS Getting Started Resources

SSIS is still once of the best integration tool in the market, https://www.gartner.com/reviews/market/data-integration-tools. Below has some resources you can utilize on. Getting started https://docs.microsoft.com/en-us/sql/integration-services/sql-server-integration-services?view=sql-server-2017/?WT.mc_id=DP-MVP-36769 Install SSDT https://docs.microsoft.com/en-us/sql/integration-services/install-windows/install-integration-services?view=sql-server-2017/?WT.mc_id=DP-MVP-36769 Integration Services (SSIS) Tutorials https://docs.microsoft.com/en-us/sql/integration-services/lesson-1-create-a-project-and-basic-package-with-ssis?view=sql-server-2017/?WT.mc_id=DP-MVP-36769

Posted in .Net, Cloud, Community, Computers and Internet, Data Platform | Tagged | Leave a comment

Using MAX(DateTime) in SSIS get duplicated records

This post shows you a solution to eliminate duplicate records when using MAX(DateTime) in SSIS. If you have a statement SELECT MAX(DateTime) FROM DatabaseTable and assign the result to SSIS variable then most of the time you will get duplicated … Continue reading

Posted in .Net, Cloud, Community, Computers and Internet, Data Platform | Tagged | Leave a comment

SQL Server WITH (NOLOCK)

This post showing you how to use WITH (NOLOCK) without using the keyword WITH (NOLOCK). WITH (NOLOCK) is the same as READ UNCOMMITTED. It is easy for s select statement like below. SELECT * FROM [dbo].[tables] WITH (NOLOCK) If you … Continue reading

Posted in .Net, Cloud, Community, Computers and Internet, Data Platform | Tagged | Leave a comment