March 4, 2020 at 12:00 am
Comments posted to this topic are about the item Why Containers?
March 4, 2020 at 7:33 am
Possibly dumb question, but i don't understand why and i am curious.
What is the reasoning behind creating these posts before it is actually available?
I want to be the very best
Like no one ever was
March 11, 2020 at 8:47 am
We have template Python projects so that the start of any Python development has a big head start
Because we are using niche technology I have had to write my own equivalent of Redgate SQLDoc, SQL Source Control and a deployment pipeline. In the production environment the containers to execute that functionality spin up when required, do their job, terminate and evaporate. Because everything is self-contained there is no danger of the libraries from one app clashing with the libraries of another app.
My colleagues have experimented with minimising the container size so we use Linux Alpine as a base container. The trade off is that an app with many dependencies may take some development effort to get working due to the minimal install of the initial container but once it's done it's done.
Docker images can be very fast to spin up and very fast to execute what they do. They reward those who write tight, efficient code and protect systems from those who don't.
We do run databases in containers for our local development though not in production. It used to be the case that Docker containers should be regarded as stateless but this is no longer the case.
The container approach also means that I can have more of the software stack running on my workstation. This means that not only do I have great freedom to play around I can do so without impacting other people. I can learn with bravery. It also means that I am not reliant on any form of network connection to do my work.
What comes after containers? Unikernels. These are apps with their own OS but only the OS needed to do what the apps are intended to do. If your app doesn't need a display, printer, keyboard or mouse then it won't have the OS mechanisms or drivers for those things. The pay off is that a unikernal app can be tiny as in single digit Kb. This means they are blazingly fast to boot up. They carry out their tasks and shut down. Not only do they have less to hack they don't exist long enough to be hacked.
If you want to learn about Docker and Kubernetes I can recommend Nigel Poulton's courses on Pluralsight and his books.
March 11, 2020 at 9:11 am
we're writing up a plan for using kubernetes, docker and lambda functions in AWS (not a live product yet) - I'm looking forward to it
- ktflash , these are 100% available … someone correct me if i'm wrong but sql 2019 and kubernetes play nicely together
MVDBA
March 11, 2020 at 10:29 am
I'll look those courses up David - if I ever get the 2 hours necessary - thanks.
March 11, 2020 at 12:21 pm
We have template Python projects so that the start of any Python development has a big head start
<li style="list-style-type: none;">
- Virtual environment build (venv)
<li style="list-style-type: none;">
- Test framework install with sample test
<li style="list-style-type: none;">
- Library install
<li style="list-style-type: none;">
- Linter (flake8)
<li style="list-style-type: none;">
- build and test from a simple command line
<li style="list-style-type: none;">
- Container build
<li style="list-style-type: none;">
- Container push to the container repository
You mean that Python installations are that complex?
Also, @Steve... with all this wonderful talk, do you think you good folks could finally fix this site so that old code and quoted things, like the one above, don't have a bazillion extra line feeds in them? It's ridiculous how bad some of the old code windows are.
--Jeff Moden
Change is inevitable... Change for the better is not.
March 11, 2020 at 1:58 pm
This was removed by the editor as SPAM
March 11, 2020 at 3:49 pm
If you want to learn about Docker and Kubernetes I can recommend Nigel Poulton's courses on Pluralsight and his books.
Second vote for Mr Poulton. He does a great job and I've enjoyed his courses.
More of the stack is good, but there are still resource issues, especially with data. However, dropping a set of containers on servers for a dev is certainly easier than installing everything.
March 11, 2020 at 4:20 pm
if you are looking at docker and kubernetes and you are thinking about using amazon aws then start looking at AWS fargate
MVDBA
March 11, 2020 at 5:35 pm
If you are looking at kubernetes, look at AWS, Azure, or GCP. Not worth running yourself in most cases.
March 11, 2020 at 6:04 pm
No Jeff, we do it that way to ensure enforced consistencyfor all data engineers, abstracting the docker process, making sure that any engineer can run the test/build on their laptop.
Viewing 11 posts - 1 through 10 (of 10 total)
You must be logged in to reply to this topic. Login to reply