others

Using Python and MySQL in the ETL Process: Using Python and SQLAlchemy

by Emil Drkušić
26 Jun 2019 In the previous two articles of this series, we discussed how to use Python and SQLAlchemy to perform the ETL process. Today we’ll do the same, but this time using Python and SQL Alchemy without SQL commands in textual format. This will enable us to use SQLAlchemy regardless of the database engine we’re connected to. So, let’s start. Today we’ll discuss how to perform the ETL process using Python and SQLAlchemy.
Read more
others

Using Python and MySQL in the ETL Process: SQLAlchemy

by Emil Drkušić
12 Jun 2019 SQLAlchemy helps you work with databases in Python. In this post, we tell you everything you need to know to get started with this module. In the previous article, we talked about how to use Python in the ETL process. We focused on getting the job done by executing stored procedures and SQL queries. In this article and the next, we’ll use a different approach. Instead of writing SQL code, we’ll use the SQLAlchemy toolkit.
Read more
others

Using Python and MySQL in the ETL Process

by Emil Drkušić
22 May 2019 Python is very popular these days. Since Python is a general-purpose programming language, it can also be used to perform the Extract, Transform, Load (ETL) process. Different ETL modules are available, but today we’ll stick with the combination of Python and MySQL. We’ll use Python to invoke stored procedures and prepare and execute SQL statements. We’ll use two similar-but-different approaches. First, we’ll invoke stored procedures that will do the whole job, and after that we’ll analyze how we could do the same process without stored procedures by using MySQL code in Python.
Read more
others

Spreadsheets vs. Databases: Is It Time to Switch? Part 2

by Emil Drkušić
24 Jul 2018 Spreadsheets – Excel, Google Sheets, or a sheet by any other name – are really cool and powerful tools. But then, so are databases. When should you stick with a spreadsheet? When should you move up to a database?This is the continuation of my previous article “ Spreadsheets vs. Databases: Is It Time to Switch? ” where we’ve discussed the most common disadvantages of using spreadsheets to organize lots of data. In this article, we will find out how a database solves those problems.
Read more
others

Spreadsheets vs. Databases: Is It Time to Switch? Part 1

by Emil Drkušić
28 Jun 2018 Spreadsheets – Excel, Google Sheets, or a sheet by any other name – are really cool and powerful tools. But then, so are databases. When should you stick with a spreadsheet? When should you move up to a database?You can use spreadsheets and databases for similar purposes. Given that both organize data and facilitate reporting, at times it can be hard to determine which is the best one to use. So let’s talk about the pros and cons of each option.
Read more
others

Six Things You Need to Know About Securing Your Database

by Marian Dziubiak
2 May 2017 Whether you store secret government information or standard user data, you don’t want some unknown person to access to your database. Especially if they’re an evil hacker. So what can you do to protect your sensitive information?Lack of Security Is a Huge ProblemGenerally, people want to do the minimum. When they set up the database environment, they often forget about securing it. Or they rely on someone else to do it for them, as many MongoDB users did. Prior to MongoDB version 2.6.0, the default IP binding was on 0.0.0.0. This meant that unless additional security measures were implemented, anyone could connect to the server. Moreover, the database did not require authentication.
Read more
others

How to Set Up a Composite Primary Key in jOOQ and Hibernate

by Patrycja Dybka
1 Sep 2016 In today’s article, we will take a look at composite primary key support in two top Java ORMs: jOOQ and Hibernate . We’ll look at a couple examples, learn how column configuration looks in Hibernate, and how support is organized in jOOQ.Thecomposite primary keyis a key that consists of more than one column, and its column combination guarantees its uniqueness.To handle the connection to the database, the application uses libraries known as object-relational mappers, or ORMs. Let’s see how jOOQ and Hibernate support this functionality.
Read more
others

How to Develop a Simple Tic Tac Toe Game with Spring Boot and AngularJS

by Patrycja Dybka
30 Aug 2016 Everyone likes to play games, especially the simple ones. Tic tac toe is about as simple as you can get, and despite its age it is still widely played. In the past, the only way to play tic tac toe was on paper; now there are plenty of computerized options. In this article (inspired by our recent post, A Database Model for Simple Board Games ), we’ll present a tutorial on building a tic tac toe web application with Spring Boot and AngularJS. The final code is hosted on GitHub.
Read more
others

What a Concept! Is Logical Data Modeling Obsolete?

by Andrew Wolfe
19 Jul 2016 When databases were sized in megabytes rather than petabytes, their design was a well-defined discipline of data analysis and implementation. A progression of modeling steps – from conceptual and logical through relational and/or physical – promised successful deployment.But as we passed more orders of magnitude in data volume, we seemed to stop seeking modeling approaches to manage that volume. So the question arises: Is logical data modeling obsolete?To arrive at a reasonable answer, we’ll have to recover some forgotten lore about data modeling.
Read more
others

CHAR and VARCHAR Data Types in Different Database Engines

by Patrycja Dybka
31 May 2016 Storage engines can surprise you. For example, take the CHAR data type. It expects an exact number of characters and by definition stores afixed amountof information. However, you don’t have to fill all the available CHAR space – a shorter value will work. This is so similar to VARCHAR that I decided to explore the differences between these two types.Before diving into the details, let’s start with some basic information. CHAR and VARCHAR are SQL data types dedicated to storing character values. They are available in almost every database engine. Due to database and encoding particulars, the storage of character values in CHAR and VARCHAR columns differs.
Read more