SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


Machine Learning in the Database


Machine Learning in the Database

Author
Message
Steve Jones
Steve Jones
SSC Guru
SSC Guru (610K reputation)SSC Guru (610K reputation)SSC Guru (610K reputation)SSC Guru (610K reputation)SSC Guru (610K reputation)SSC Guru (610K reputation)SSC Guru (610K reputation)SSC Guru (610K reputation)

Group: Administrators
Points: 610966 Visits: 21175
Comments posted to this topic are about the item Machine Learning in the Database

Follow me on Twitter: @way0utwest
Forum Etiquette: How to post data/code on a forum to get the best help
My Blog: www.voiceofthedba.com
xsevensinzx
xsevensinzx
SSC-Insane
SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)

Group: General Forum Members
Points: 21741 Visits: 5895
I've been dealing with similar this week. The reality is, very few data sources for these reports allow for real-time execution of R code from the back-end outside of embedding R code on the front-end. From a small business standpoint, this is totally fine. But, when you get into larger organizations, having to manage hundreds of R code implementations on the front-end is a pain. Having the ability to store, execute, train, and return predictions from something as simply calling a stored procedure is extremely powerful. No other data source really does that in many of the front-end tools you may use to visualize the data.

Thus, to force the machine learning down the path of writing all the code in the app versus storing it in the back-end is something you might want to think long and hard about. Simply storing the pre-trained data is not going to be enough if you get serious with ML.
Jeff Moden
Jeff Moden
SSC Guru
SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)

Group: General Forum Members
Points: 883307 Visits: 47900
You also have to ensure that the machine is learning what is actually necessary. I recently bought a new Chevy Silverado and the amount of SPAM I now get about Chevy Silverado's being on sale is insane. I just bought one... why the hell would anyone think I'm in the market for another? Stupid. Just plain stupid. The machine learned how to be a total moroff ("Moroff" is worse than "Moron" because it's more off than on BigGrin).

--Jeff Moden

RBAR is pronounced ree-bar and is a Modenism for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column.
If you think its expensive to hire a professional to do the job, wait until you hire an amateur. -- Red Adair

Helpful Links:
How to post code problems
How to post performance problems
Forum FAQs
skeleton567
skeleton567
Hall of Fame
Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)

Group: General Forum Members
Points: 3825 Visits: 701
Well, admittedly I'm old school here when it comes to this topic. I have to think that we would be smart to keep our servers focused on the traditional tasks of storage and retrieval of DATA for presentation to the front-end (either user machines or other servers) for them to analyze and create the INFORMATION for the end user. While a single or a few analytical processes may be OK, unless there is really, really good design and development, it is very likely that there are going to be waits while data is manipulated taking cycles away from the data movement. And unless we now get DBA's highly trained and experienced in the analysis process, our main focus is going to suffer. As the old idea said, that I think originated years ago even before the client/server concept existed, use the KISS method - keep it simple, Stupid. And of course, this harks back to earlier discussions regarding the continuing issue of how much detail data to retain online, how much summarization to do, etc. Combining ever growing quantities of data with ever-increasing processing of that data appears to be a place we may not want to go. When it comes to taking on all the processing tasks, it seems maybe we should 'be careful what we ask for - we just might get it'.
skeleton567
skeleton567
Hall of Fame
Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)

Group: General Forum Members
Points: 3825 Visits: 701
Jeff Moden - Tuesday, June 12, 2018 7:40 AM
You also have to ensure that the machine is learning what is actually necessary. I recently bought a new Chevy Silverado and the amount of SPAM I now get about Chevy Silverado's being on sale is insane. I just bought one... why the hell would anyone think I'm in the market for another? Stupid. Just plain stupid. The machine learned how to be a total moroff ("Moroff" is worse than "Moron" because it's more off than on BigGrin).


Exactly my point, Jeff. DBA's are not likely to be in control of what all the code executing on their servers are doing, but it will be consuming resources that should be available for the storage and retrieval processes. I'm for keeping all that workload off the servers. Back when I started in mainframe days of the 60's we had no choice about it. Anything that was to be done had to be in the same process. Do we really want to go back to that?
Jeff Moden
Jeff Moden
SSC Guru
SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)SSC Guru (883K reputation)

Group: General Forum Members
Points: 883307 Visits: 47900
skeleton567 - Tuesday, June 12, 2018 7:58 AM
Jeff Moden - Tuesday, June 12, 2018 7:40 AM
You also have to ensure that the machine is learning what is actually necessary. I recently bought a new Chevy Silverado and the amount of SPAM I now get about Chevy Silverado's being on sale is insane. I just bought one... why the hell would anyone think I'm in the market for another? Stupid. Just plain stupid. The machine learned how to be a total moroff ("Moroff" is worse than "Moron" because it's more off than on BigGrin).


Exactly my point, Jeff. DBA's are not likely to be in control of what all the code executing on their servers are doing, but it will be consuming resources that should be available for the storage and retrieval processes. I'm for keeping all that workload off the servers. Back when I started in mainframe days of the 60's we had no choice about it. Anything that was to be done had to be in the same process. Do we really want to go back to that?


Agreed. I'll also state that "BI" is frequently an oxymoron (although some good souls actually DO get it right!), machine learned or not. BigGrin

--Jeff Moden

RBAR is pronounced ree-bar and is a Modenism for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
Stop thinking about what you want to do to a row... think, instead, of what you want to do to a column.
If you think its expensive to hire a professional to do the job, wait until you hire an amateur. -- Red Adair

Helpful Links:
How to post code problems
How to post performance problems
Forum FAQs
Lynn Pettis
Lynn Pettis
SSC Guru
SSC Guru (396K reputation)SSC Guru (396K reputation)SSC Guru (396K reputation)SSC Guru (396K reputation)SSC Guru (396K reputation)SSC Guru (396K reputation)SSC Guru (396K reputation)SSC Guru (396K reputation)

Group: General Forum Members
Points: 396063 Visits: 43183
Jeff Moden - Tuesday, June 12, 2018 7:40 AM
You also have to ensure that the machine is learning what is actually necessary. I recently bought a new Chevy Silverado and the amount of SPAM I now get about Chevy Silverado's being on sale is insane. I just bought one... why the hell would anyone think I'm in the market for another? Stupid. Just plain stupid. The machine learned how to be a total moroff ("Moroff" is worse than "Moron" because it's more off than on BigGrin).


How do you like the Silverado? I bought a 2018 Chevy Colorado for the trip to/from Rhode Island. I like the truck, handles well, and did well with the trailer we towed to Rhode Island.

Cool
Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
skeleton567
skeleton567
Hall of Fame
Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)Hall of Fame (3.8K reputation)

Group: General Forum Members
Points: 3825 Visits: 701
Lynn, for what it's worth, I've been around trucks all my life and driven pickups since I was 16. (Now 75). I have a 2010 Ford F-150 with 110k miles, and it's the best I've ever had. We love it for long distance travel, choosing it over our Buick Park Avenue, for regular trips Indiana to Colorado, etc. Great comfort, ride, sound system, power enough to pull a 16' travel trailer, except for the highest mountain passes. We do those in our 4-seater ATV.🤓I
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum








































































































































































SQLServerCentral


Search