Big Data Systems (WT 2019/20)

Prof. Dr. Tilmann Rabl


The amount of data that can be generated and stored in academic and industrial projects and applications is increasing rapidly. Big data analytics technologies have established themselves as a solution for big data challenges to the scalability problems of traditional database systems. The vast amounts of new data that is collected, however, usually is not as easily analyzed as curated, structured data in a data warehouse is. Typically, these data are noisy, of varying format and velocity, and need to be analyzed with techniques from statistics and machine learning rather than pure SQL-like aggregations and drill-downs. Moreover, the results of the analyses frequently are models that are used for decision making and prediction. The complete process of big data analysis is described as a pipeline, which includes data recording, cleaning, integration, modeling, and interpretation.

In this lecture, we will discuss big data systems, i.e., infrastructures that are used to handle all steps in typical big data processing pipelines.

Lectures

Introduction

Date: October 15, 2019
Language: English
Duration: 01:15:49

Database Systems Recab

Date: October 22, 2019
Language: English
Duration: 01:29:32

RDBMS Internals

Date: October 24, 2019
Language: English
Duration: 01:12:54

Big Data Stack

Date: November 5, 2019
Language: English
Duration: 01:30:37

Benchmarking und Measurement

Date: November 12, 2019
Language: English
Duration: 01:27:04

Benchmarks

Date: November 14, 2019
Language: English
Duration: 01:27:59

Cloud Computing

Date: November 20, 2019
Language: English
Duration: 01:28:53

Distributed File Systems

Date: November 26, 2019
Language: English
Duration: 01:29:13

Map Reduce

Date: November 28, 2019
Language: English
Duration: 01:21:21

Map Reduce 2

Date: December 3, 2019
Language: English
Duration: 01:28:01

Wide Column Stores

Date: December 10, 2019
Language: English
Duration: 01:26:35

Key Value Stores

Date: December 12, 2019
Language: English
Duration: 01:30:15

Key Value Stores & Stream Processing Systems I

Date: December 17, 2019
Language: English
Duration: 01:25:38

Databases On Modern Hardware

Date: January 9, 2020
Language: English
Duration: 01:25:10

Stream Processing Systems I - Part 2

Date: January 9, 2020
Language: English
Duration: 01:30:26

Ad-hoc Stream Querry Processing & Stream Processing Systems 1

Date: January 14, 2020
Language: English
Duration: 01:28:26

Machine Learning Systems - Introduction

Date: January 16, 2020
Language: English
Duration: 01:24:35

Machine Learning Systems - Introduction - Part 2

Date: January 23, 2020
Language: English
Duration: 01:26:14