Whether you are running an RDBMS, or a Big Data system, it is important to consider your data-partitioning strategy. As the volume of data grows, so it becomes increasingly important to match the way you partition your data to the way it is queried, to allow 'pruning' optimisation. When you have huge imports of data to consider, it can get complicated. Bartosz explains how to get things right; not perfect but wisely.
2016-11-22
3,345 reads
Rob Farley discusses some solutions and gotchas for implementing a custom sort using ORDER BY in T-SQL queries.
2016-11-21
3,624 reads
It is worth getting familiar with Apache Spark because it a fast and general engine for large-scale data processing and you can use you existing SQL skills to get going with analysis of the type and volume of semi-structured data that would be awkward for a relational database. With an IDE such as Databricks you can very quickly get hands-on experience with an interesting technology.
2016-11-18
3,131 reads
Receiving an access denied error message when trying to connect to a remote instance of SSIS from SSMS? Sadequl Hussain provides the solution.
2016-11-17
4,199 reads
Power BI Desktop continues to evolve. There have been many improvements to the reporting side that together make it easier to get from the data to the visualisation as quickly as possible. You can now create line charts that let users drill down into hierarchical data. There are now ways of adding dynamic reference lines to a visualization that provide users with relevant reference points. Robert Sheldon demonstrates how to combine these features to great effect.
2016-11-16
3,166 reads
"I’ve noticed that many indexes in my data warehouse aren’t used frequently. Is there a way to use the automatically generated statistics to make useful indexes?"
Kendra Little answers the question in episode 18 of Dear SQL DBA.
2016-11-15
4,733 reads
To err is human, or so the saying goes. Unfortunately, in the world of IT, innocuous mistakes made early on can lead to really daunting problems down the road. In this article, Rob Gravelle goes over a few of the most common DBA mistakes to avoid. Some of these relate specifically to MySQL, while others may be applicable to any RDBMS.
2016-11-14
4,315 reads
It is a common problem with a web page that a form is too complex to fit easily on the page. You can, of course, rely on the scrollbar, but it soon becomes a daunting and erratic process for the poor user. Wizards, that allow you to guide the user through a process, are great but take time to set up. Is there a simple solution for those occasions where there is too much data-entry for a form but a full wizard seems like overkill?
2016-11-11
3,292 reads
Marcin Policht focuses on the specifics of using Azure Active Directory to authenticate to Azure SQL Database.
2016-11-10
5,620 reads
Though duplicate rows are bad practice, sometimes they're necessary for a short time. But how do you clean your tables when they're no longer needed? Sergey Gigoyan provides a few different solutions.
2016-11-09
3,155 reads
By Ed Elliott
Running tSQLt unit tests is great from Visual Studio but my development workflow...
By James Serra
I remember a meeting where a client’s CEO leaned in and asked me, “So,...
By Brian Kelley
If you want to learn better, pause more in your learning to intentionally review.
Hello SSC, Has anyone encountered this before??? I have an odd issue that I...
Hello team Can anyone share popular azure SQL DBA certification exam code? and your...
Comments posted to this topic are about the item Faster Data Engineering with Python...
I have this code in SQL Server 2022:
CREATE SCHEMA etl;
GO
CREATE TABLE etl.product
(
ProductID INT,
ProductName VARCHAR(100)
);
GO
INSERT etl.product
VALUES
(2, 'Bee AI Wearable');
GO
CREATE TABLE dbo.product
(
ProductID INT,
ProductName VARCHAR(100)
);
GO
INSERT dbo.product
VALUES
(1, 'Spiral College-ruled Notebook');
GO
CREATE OR ALTER PROCEDURE etl.GettheProduct
AS
BEGIN
exec('SELECT ProductName FROM product;')
END;
GO
exec etl.GettheProduct
When I execute this code as a user whose default schema is dbo and has rights to the tables and proc, what is returned? See possible answers