Videos uploaded by user “Postgres Conference”
The Elephants In The Room: Limitations of the PostgreSQL Core Technology
Check out http://www.pgconf.us/2015/event/85/ for the full talk details. The core architecture of PostgreSQL is significantly different from that of competing products like Oracle, SQL Server, or MySQL, which also differ from each other. Some of PostgreSQL's distinctive features, such as our highly extensible systems for adding new data types and new foreign data wrappers, have been tremendously successful in propelling PostgreSQL forward. Others, such as our storage format and limited replication capabilities, have significantly impeded the adoption of PostgreSQL. In this talk, I'll discuss some of the core architectural problems that I believe limit our success, based on my experiences working with EnterpriseDB customers, and will suggest some ways in which I believe the PostgreSQL architecture can evolve to meet those challenges. About the Speaker Robert has been involved in the PostgreSQL project since 2008, first as a patch reviewer and committer and a later as a major developer. Prior to that, he was a PostgreSQL application developer for nearly ten years. Features he has worked on include infrastructure for parallelism (for 9.4), the replacement of System V shared memory with anonymous shared memory (for 9.3), read and write scalability improvements (for 9.2), index-only scans (with Heikki Linnakangas and Ibrar Ahmed, for 9.2), unlogged tables (for 9.1), and left join removal (for 9.0). He works at EnterpriseDB as Chief Database Architect for the Database Server.
Views: 14810 Postgres Conference
Scale-out PostgreSQL with Postgres-XL
Check out http://www.pgconf.us/2015/event/67/ for the full talk details. Open source Postgres-XL allows users to scale-out PostgreSQL for both OLTP and OLAP workloads, all while maintaining cluster-wide consistency across multiple nodes. This session will discuss the capabilities of Postgres-XL and how, by bringing massively parallel processing (MPP) to the community, PostgreSQL becomes a strong candidate for Big Data analytics. In addition, we discuss how Postgres-XL implements cluster-wide ACID and Multi-version Concurrency Control (MVCC) support. There will also be a demo of how to install a small local cluster on your laptop for testing. About the Speaker Mason Sharp has been an active developer of multiple PostgreSQL cluster projects. He is the original architect of GridSQL as well as a member of the original Postgres-XC development team.
Views: 5646 Postgres Conference
Citus Data: Scale out PostgreSQL
Check out http://www.pgconf.us/2015/event/113/ for the full talk details. We'll talk about the trends we see in the big data space, and challenges associated with scaling out databases. We'll then describe the properties unique to PostgreSQL, and how we're leveraging them to scale out. About the Speaker Ozgun is a co-founder and the CTO at Citus Data. Prior to Citus, Ozgun worked as a software developer for four years in the Distributed Systems Engineering team at Amazon. There, he proposed, designed, and implemented novel algorithms on distributed caching and consistency; and also worked on building systems for scalable data analytics. Ozgun earned his M.S. in Computer Science from Stanford University, and his B.S. from Galatasaray University. He also holds patents on distributed cache consistency and load balancing.
Views: 1426 Postgres Conference
At The Heart Of A Giant: Postgres At TripAdvisor
Check out http://www.pgconf.us/2015/event/95/ for the full talk details. Since TripAdvisor’s early days as a scrappy start up, Postgres has been at the core of our infrastructure. We’ve grown up with Postgres from our early 7.x series single database setup, to our current mix of 9.1+ installed across over 100 dedicated Postgres servers in 4 datacenters. Postgres’ flexibility and sheer resilience to whatever we throw at it has served us well. This means: * 2 core-site datacenters with Postgres infrastructure tested to be capable of handling well over 1,100,000 database queries per minute. * Replication between those data centers running in a master-slave model with a scheduled role-reversal every 3 months. * Distinct core-site SLA’s for read only availability, and read write availability. No scheduled outages; less than 30 minutes per year of scheduled read only time. * 3 different flavors of replications with at least 5-6 distinct types of replication topologies. * 3 distinct development environments for engineers complete with full database snapshots that refresh from production every week. * Varying different workloads including: * Servers with 768GB of RAM so everything fits in memory. * Multi terabyte databases where only 5% can fit in RAM. * A sharded core site (not warehouse!) table with over 2,600,000,000 tuples. * Real time main site anomaly detection database that ingests 87,000 tuples per second. * All of this is maintained by a a team of 1 person full time and 4 people part time. This talk will be a look at how Postgres can form the backbone of a site at the scale of 315 million unique visitors a month. About the Speaker Matt Kelly has been working with TripAdvisor for the past 3.5 years, starting as a general software engineer. Last year he switched over to the operations team to be the person focused on advancing the Postgres infrastructure at TripAdvisor.
Views: 3016 Postgres Conference
JSON and PostgreSQL, the State of the Art
Check out http://www.pgconf.us/2015/event/98/ for the full talk details. PostgreSQL 9.4 introduces a new type, JSONB, index types, operators... all kinds of new infrastructure for processing JSON. It's all rather overwhelming. We'll look at the current set of tools, including real-life applications and performance metrics, and talk about options as to when it is a great and perhaps still not-as-great idea to use JSON. About the Speaker Christophe has been working with PostgreSQL since 1997.
Views: 3686 Postgres Conference
Fashion Is Hard. PostgreSQL Is Easy.
Check out http://www.pgconf.us/2015/event/108/ for the full talk details. Everybody loves fashion! That's why Zalando has managed to grow from a small, Berlin-based startup into Europe’s leading online fashion platform in just five years. But growing into a 15-country, publicly traded fashion destination can be difficult. Our creative team of product owners propose new ideas and feature requests every day, and our developers have to work hard to keep up with this pace of constant innovation. Relying on traditional relational database systems is perceived to be a limiting strategy when working in fast-paced development environments, mostly because these systems lack concurrent data model changes, offer only a few sets of data types, and present upfront complexity when it comes to learning how they work. About the Speaker I am leading database development team Zalando for 4 years now. Back then it was a very fast growing start-up with about 40 developers and my goal was to ensure, that company can grow fast and that developers have as little problems using relational databases as possible. Now, as Zalando became one of the biggest online fashion retailers in Europe and Zalando Technology employs more then 600 people, PostgreSQL stays the database of choice for storing and processing most of the data, including financial, customer and logistics processing information. I and my team have gathered huge experience on every aspect of PostgreSQL operations, starting from managing database hardware and finishing with organizing efficient and fast development process that lets our teams roll out hundreds of database model changes per week.
Views: 14782 Postgres Conference
How PostgreSQL is tested
How do we know PostgreSQL works? What do "regression tests", "isolation tests", "TAP tests" do? What does the build farm do? What is the community's role in testing? What are the strengths and weaknesses of the testing methodologies and tools and how can we improve them? I invite all existing hackers to join me so we can share our experiences and visions. For users who are not yet hackers, this presentation is a great way to learn about important development tools and practices of the PostgreSQL hacker community. http://www.pgconf.us/2016/event/123/how-postgresql-is-tested/
Views: 5316 Postgres Conference
How does PostgreSQL work with disks: a DBA’s checklist in detail
Check out http://www.pgconf.us/2015/event/82/ for the full talk details. PostgreSQL like any other classical database interacts with disks heavily and has dozens of disk-related settings. In order to keep an instance up and running under even moderate workloads, an average DBA needs to dig through PostgreSQL documentation, operating system documentation, hardware vendor manuals, a few books, plenty of blog posts, [HACKERS] and [PERFORM] mail lists archive and finally gain a couple years of experience. This talk will guide DBAs through a checklist, that allows to maximize the disk performance of a PostgreSQL installations. I will concisely summarize typical DBA tasks on four levels: choosing and setting up hardware, operating system configuration, file system mounting with proper options, and PostgreSQL tuning itself. The talk will include but is not limited to such important topics as monitoring I/O-related metrics, checkpoint tuning, autovacuum tuning. About the Speaker Ilya is a co-founder and DBA at PostgreSQL-Consulting.com. His previous experience encompasses such commercial databases as Oracle and DB2. Currently, Ilya works primarily with PostgreSQL with a focus on its performance and effective use in production. He sees the mission of PostgreSQL in substituting the commercial databases in high-performance mission-critical applications.
Views: 4247 Postgres Conference
PostgreSQL Disaster Recovery with Barman
Check out http://www.pgconf.us/2015/event/92/ for the full talk details. Are you tired of managing backup and recovery processes of your Postgres server using custom scripts? Are you worried about being called in the night or worse whilst on holiday to perform a recovery operation of your company's business critical PostgreSQL server? Barman, Backup and Recovery Manager, standardises backup and recovery operations, allowing database administrators and system administrators to easily integrate their PostgreSQL solutions in their disaster recovery plan. New ideas, which will be part of version 2 of Barman, will be unveiled during the presentation. Barman is distributed as open source under GNU GPL 3 terms. Further information available at www.pgbarman.org. About the Speaker A long time open-source programmer, Gabriele has been writing Linux/Unix applications in C and C++ for over 15 years, specialising in search engines and web analytics with large databases. Gabriele has a degree in Statistics from the University of Florence. His areas of expertise are data mining and data warehousing, having worked on web traffic analysis in Australia and Italy. Gabriele is a principal consultant with 2ndQuadrant and an active member of the international PostgreSQL community.
Views: 7098 Postgres Conference
Kicking the Donkey of PostgreSQL Replication  Joshua D  Drake
Fully updated from 2014, this talk takes into account all the goodies that are available for PostgreSQL replication including but not limited to: * Streaming Replication * Archiving Replication * Management of both types * Logical Replication (PgLogical) If you are new to PostgreSQL replication this talk will provide you with everything you need to know about 95% of PostgreSQL Replication technology. Questions are invited and lively discussion is expected. Bring your best thinking hats and let's solve some data transfer problems! http://www.pgconf.us/2016/event/145/kicking-the-donkey-of-postgresql-replication/
Views: 631 Postgres Conference
An Introduction to Temporal Databases
Check out http://www.pgconf.us/2015/event/83/ for the full talk details. In the past manipulating temporal data was rather ad hoc and in the form of simple solutions. Today organizations strongly feel the need to support temporal data in a coherent way. Consequently, there is an increasing interest in temporal data and major database vendors recently provide tools for storing and manipulating temporal data. However, these tools are far from being complete in addressing the main issues in handling temporal data. The presentation uses the relational data model in addressing the subtle issues in managing temporal data: comparing database states at two different time points, capturing the periods for concurrent events and accessing to times beyond these periods, sequential semantics, handling multi-valued attributes, temporal grouping and coalescing, temporal integrity constraints, rolling the database to a past state and restructuring temporal data, etc. It also lays the foundation in managing temporal data in NoSQL databases as well. Having ranges as a data type PostgresSQL has a solid base in implementing a temporal database that can address many of these issues successfully. About the Speaker Abdullah Uz Tansel is professor of Computer Information Systems at the Zicklin School of Business at Baruch College and Computer Science PhD program at the Graduate Center. His research interests are database management systems, temporal databases, data mining, and semantic web. Dr. Tansel published many articles in the conferences and journals of ACM and IEEE. Dr. Tansel has a pending patent application on semantic web. Currently, he is researching temporality in RDF and OWL, which are semantic web languages. Dr. Tansel served in program committees of many conferences and headed the editorial board that published the first book on temporal databases in 1993. He is also one the editors of the forth coming book titled Recommendation and Search in Social Networks to be published by Springer. He received BS, MS and PhD degrees from the Middle East Technical University, Ankara Turkey. He also completed his MBA degree in the University of Southern California. Dr. Tansel is a member of ACM and IEEE Computer Society.
Views: 4431 Postgres Conference
The Future of PostgreSQL Multi-Master Replication
Check out http://www.pgconf.us/2015/event/100/ for the full talk details. The BDR project works on delivering robust, featurefull and fast asynchronous multimaster replication to postgres. UDR shares most of the code and infrastructure with BDR and provides unidirectional logical replication for the cases where multimaster is not required. We'll discuss: * What scenarios are good for asynchronous multimaster? * In which cases won't it work? * What methods exist to avoid and resolve conflicts? * Performance! * What's the relationship with core postgres? * The Future About the Speaker Andres Freund is a developer and consultant at 2ndQuadrant Ltd. He is developing and sometimes even using Postgres and other Open Source projects since 2005. Before his current job he worked as a freelancing consultant in the area of databases and software engineering for several years.
Views: 4351 Postgres Conference
A TARDIS for your ORM - application level time travel in PostgreSQL
Check out http://www.pgconf.us/2015/event/60/ for the full talk details. What do you do when your requirements say you need to be able to reproduce the exact same results that a query did sometime in the past? Including to be able to reproduce incorrect statistics on data that has since been corrected? And being able to reproduce exactly which rows were returned by a query in the past? Well, you do like any time lord would do - break out the TARDIS. Or maybe just use PostgreSQL.. This talk will outline a technique to use some PostgreSQL features, including range types and exclusion contraints/indexes, to trick an ORM application to work with transparent time travel, with the goal of close to zero modifications to the application, while maintaining consistency. About the Speaker Magnus Hagander is a member of the PostgreSQL Core Team and a developer and code committer in the PostgreSQL Global Development Group. These days, Magnus mostly works on other parts of the PostgreSQL backend, recently with a focus on security features, monitoring and backup/replication interfaces and tools. He is also one of the core members of the postgresql.org infrastructure team, maintaining the servers that power the project, and one of the maintainers of the postgresql.org website. He also contributes to pgAdmin and other related projects. He's been a PostgreSQL user since version 6 (with some non-serious use of Postgres 95 before that), and currently serves on the Core Team and as President of the Board for PostgreSQL Europe. To pay the bills, he is a PostgreSQL and open source software consultant at Redpill Linpro in Stockholm, Sweden, where he works on consulting, support and training services, as well as custom development work.
Views: 784 Postgres Conference
Fun with Functions, by Example
Check out http://www.pgconf.us/2015/event/58/ for the full talk details. One of the key strengths of PostgreSQL is its extensability, and at the core of that are functions. In PostgreSQL functions can be used as an end in-and-of themselves, or they can be used to allow the creation of other custom SQL objects such as operators and aggregates. This presentation will enlighten the audience on the vast array of capabilities embodied in PostgreSQL functions, and illustrate many of the key features through simple and real world examples. About the Speaker Joe Conway is an innovative leader with broad experience in a wide array of disciplines and extensive international business exposure. He has been involved with PostgreSQL as a user since 1998, and a contributor since 2001. He is also the author and maintainer of a PostgreSQL procedural language handler for the R language, PL/R. Joe is currently President/CEO of credativ USA, which specializes in open source software with its "Open Source Support Center" and a comprehensive range of services, including consulting, architectural and technical advice, software development, training, and personalized support.
Views: 3229 Postgres Conference
Advanced use of pg_stat_statements: Filtering, Regression Testing & More
Check out http://www.pgconf.us/2015/event/76/ for the full talk details. This talk will go into lessons learned when using the pg_stat_statements extension for collecting query statistics, and present new open-source tools we’ve developed for working with the extension output: pg_query: A Ruby extension to parse SQL queries into parse trees using the PostgreSQL parser. This can be used for filtering pg_stat_statements output (e.g. finding all queries on a certain table) and works with normalized queries, thanks to parser patches. pg_simulator: Tool for loading production statistics into a sandbox database and running EXPLAIN against collected queries. Useful for regression testing before deploying new versions of client applications to production (and finding missing indices, etc). This talk is primarily aimed at database admins trying to monitor database performance, and hackers interested in the tooling & pg_stat_statements bug fixes we’ll propose for the 9.5 cycle. About the Speaker Founder & Tech at pganalyze.com, the Hosted PostgreSQL Performance Monitoring Tool. Helping out ProductHunt.com with their scaling efforts. Author of pg_query (Ruby extension to parse queries using the raw_parser) and pg_simulator (Helper tool for copying production statistics to a test system). I love working with PostgreSQL statistics and visualizing them.
Views: 1819 Postgres Conference
Connection pooling, routing, and queuing with PgBouncer
Check out http://www.pgconf.us/2015/event/65/ for the full talk details. PgBouncer is primarily thought of as a connection pooler, but it can be much more. As a key component in many high-performance PostgreSQL installations, PgBouncer can help with connection routing, queuing, load management, and database maintenance. Learn how to use PgBouncer, how to configure it for the right application, how to monitor it appropriately, what errors to look for, and when to consider alternatives. About the Speaker Peter Eisentraut is a developer on the PostgreSQL project, a database administrator, and a compulsive automator of everything.
Views: 3367 Postgres Conference
How PostgreSQL powers a growing biomedical and health informatics research program
Check out http://www.pgconf.us/2015/event/90/ for the full talk details. PostgreSQL backs numerous research initiatives at the Department of Biomedical and Health Informatics (DBHi) within The Children's Hospital of Philadelphia (CHOP). PostgreSQL is a key component supporting the DBHi mission to solve challenging problems in the collection, management, analysis and interpretation of biomedical, genomic and clinical data. We use these solutions to advance child health through the implementation and evaluation of pediatric health information technology. About the Speaker Alex is currently a Data Integration Analyst at The Children’s Hospital of Philadelphia. He helps to provide integrative data and software solutions in translational, clinical and biological research. Seeing the robustness of PostgreSQL, it’s now his only choice for the various Bioinformatics projects he works on.
Views: 295 Postgres Conference
You'd better have tested backups  - Dimitri Fontaine
A PostgreSQL data recovery tale from a true story, where we dig deeper and deeper into the PostgreSQL internals in order to be able to get back some data from a destroyed cluster. If that story doesn't leave you wanting to check all your backups before the talk has ended, I don't know what will. http://www.pgconf.us/2016/event/149/youd-better-have-tested-backups/
Views: 649 Postgres Conference
PubSub with Postgresql  Gian Biondi
A lesser known feature of Postgresql is it's publisher/subscriber functionality. Postgresql implements pub/sub through it's LISTEN/NOTIFY functions. This talk will discuss the basics of pub/sub, how to use LISTEN/NOTIFY and a walk through of a system that uses it to synchronize a cache between multiple instances of a web application connected to a single postgres database. http://www.pgconf.us/2016/event/130/pubsub-with-postgresql/
Views: 870 Postgres Conference
SQL and MongoDB how PostgreSQL brought them together  Asya Kamsky
Have you heard that MongoDB 3.2 shipped a connector for Reporting tools that's actually PostgreSQL? This talk will provide some history, challenges of bringing together unstructured data with traditional structured tools, as well as some examples of technical obstacles that have to be overcome to bring the users what they need. http://www.pgconf.us/2016/event/139/sql-and-mongodb-how-postgresql-brought-them-together/
Views: 489 Postgres Conference
Rank Your Results: Using Full Text Search with Natural Language Queries to get Ranked Results
Check out http://www.pgconf.us/2015/event/73/ for the full talk details. PostgreSQL text search has the capability to perform natural language searches and return a ranked list of matching documents, similar to a Google-style search. The capability, along with an automatic list of 'stop' words that are ignored and synonyms that are matched, is excellent for advanced document and comment-field search applications. About the Speaker Jamey Hanson is a reformed Oracle database administrator and developer currently working to migrate US Federal Government Oracle applications to PostgreSQL. He has presented at multiple Oracle and PostgreSQL conferences as well as taught Oracle, Internet Security and Project Management for the University of Maryland. He is interested in using PostgreSQL to explore large data sets.
Views: 898 Postgres Conference
HA PostgreSQL cluster with repmgr and pgbouncer  Jaime Casanova
A real-world example of how to configure HA for PostgreSQL using repmgr for failure detection and failover, and pgbouncer to isolate the old master. This example is based in a real case we have in Ecuador that has survived some network outages and other kind of not expected failures http://www.pgconf.us/2016/event/133/ha-postgresql-cluster-with-repmgr-and-pgbouncer/
Views: 1945 Postgres Conference
Building a 'Database of Things' with Foreign Data Wrappers
Check out http://www.pgconf.us/2015/event/64/ for the full talk details. PostgreSQL Foreign Data Wrappers are an excellent mechanism for turning the "Internet of Things" into a "Database of Things". In this talk we'll explore what Foreign Data Wrappers are and how to write new ones by looking at examples integrating data objects with real world objects. About the Speaker Rick has spent decades working with systems and databases for large and small companies across many industries. He is based in Columbus,Ohio. He currently works as the Data Scientist and Platform Architect for a small multichannel, data-driven marketing agency with offices in NYC, Columbus, and San Francisco. ( http://www.geardigital.com )
Views: 1513 Postgres Conference
Monitoring Postgres from the ground up: the metrics that matter
Check out http://www.pgconf.us/2015/event/72/ for the full talk details. Postgres is at the heart of Datadog's monitoring service. Since we eat our own dogfood and spend a lot of time monitoring Postgres, I will cover in detail the metrics we care about and illustrate them with detailed data from real performance issues. This talk is a tutorial that should appeal to the Postgres neophyte and the experienced practitioner alike. About the Speaker As one of the founders of Datadog, Alexis spends a lot of time thinking about how to make monitoring work for engineering and ops teams. Prior to founding Datadog, Alexis Lê-Quôc served as the Director of Operations for Wireless Generation where he built the team and infrastructure that served millions of K-12 students across the country. He has presented sessions on cloud monitoring and server performance at conferences including DevOpsDays, Surge, Velocity, PyCon.
Views: 2927 Postgres Conference
ToroDB: a new, open-source, document-oriented, JSON database, built on Postgres
Check out http://www.pgconf.us/2015/event/103/ for the full talk details. ToroDB is a document oriented, Mongo-compatible, open-source database built on top of PostgreSQL. Why all NoSQL databases are doing everything from scratch? Concurrency, durability, journaling... all those are quite tough goals to achieve. Aren't RDBMs good enough? We think they are, specially PostgreSQL. So we built ToroDB, a new “NoSQL” database, that speaks JSON, and uses PostgreSQL as the “storage layer”. ToroDB doesn't use PostgreSQL's fantastic jsonb type; it instead offers a novel approach storing data relationally. JSON documents are split into parts, each of which is stored in a relation (table). This has several advantages, which will be outlined during the course of the talk. ToroDB implements the MongoDB protocol, and is thus compatible with MongoDB applications. This means it supports the advanced MongoDB query language, and MongoDB language updates. And it's all open source and running on top of PostgreSQL :) About the Speaker Álvaro is a 35 year-old IT entrepreneur, founder of a couple of software tech companies (Wizzbill and 8Kdata). He's a DBA and Java developer at 8Kdata, a company developing products for PostgreSQL, Java and AWS. He is also the founder and CEO of Wizzbill, a startup that offers smartphone/web products and services to help mobile phone users save money on their phone bill. He is a passionate software developer and open source advocate. Álvaro is the founder and lead project management and architect for ToroDB
Views: 1030 Postgres Conference
Vitesse DB: 100% PostgreSQL, 100 Times Faster for Analytics
Check out http://www.pgconf.us/2015/event/112/ for the full talk details. Vitesse DB is PostgreSQL for data warehouse. Rapid advances in memory, SSD, and core-count have produced affordable, powerful computers that comfortably fit the working sets of most DW queries on a single machine without resorting to MPP. Unfortunately, processing speed and single-threaded limitations have precluded PostgreSQL from DW applications. In this talk, we will describe how we made TPCH Q1 run more than 100X faster on a Postgres instance. In particular, how we dramatically increase per-core efficiency of the Executor using LLVM for dynamic query compilation, and how we thread and scale query execution across many cores efficiently, yet still maintain 100% compatibility with PostgreSQL. About the Speaker I am Founder at Vitesse Data. Prior to that, I worked at Elance-oDesk as Director of Data Services, and at Greenplum as Sr. Architect. Experienced in data systems, and in particular, MPP data warehouse systems dating back to Informix XPS.
Views: 1574 Postgres Conference
IO in Postgres   Architecture, Tuning, Problems  Andres Freund
To get the most out of PostgreSQL when used in an I/O intensive environment will often require some tuning. Aside from a few basic guidelines, tuning requires some understanding of how Postgres does I/O, how it caches data and so forth. Among others we'll go through the architecture of the buffer cache ('shared_buffers'), how checkpointing (checkpoint_segments) influences performance, what the wal writer and background writer do; and how to tune each of those. While hopefully most of the time staying above the too nitty gritty details of how exactly things are implemented. In addition there are some recognized problems with postgres in that area - I'll try to describe which those are, and how those might be/are getting fixed. http://www.pgconf.us/2016/event/151/io-in-postgres-architecture-tuning-problems/
Views: 1646 Postgres Conference
The Image of Postgres
Check out http://www.pgconf.us/2015/event/110/ for the full talk details. Let's get philosophical. How do you think about what a database is? If you think of a database as only a place to store your data, then perhaps it does not really matter what the internals of that database are; all you really need is a home for your data to be managed, nothing more. If you think of a database as a place where you develop applications, then your expectations of your database software change. No longer do you only need data management capabilities, but you require processing functions, the ability to load in additional libraries, interface with other databases, and perhaps even additional language support. If your database is just for storage, there are plenty of options. If your database is your development framework, you need Postgres. Why? Well, let’s get philosophical. About the Speaker r0ml is an amateur philosopher and juggler -- and a software professional. He would be a professional philosopher or juggler if he could, but data-driven philosophy is harder than data-driven programming, and juggling requires more precision and a lower tolerance for error than software -- so it's just easier to be a programmer. He prefers juggling clubs over balls and rings, and favors semasiology and epistemology over other branches of philosophy. He is also a Distinguished Engineer of the ACM.
Views: 1538 Postgres Conference
Migrating a live Postgres database into RDS with no downtime  Experiences and Lessons Learned  David
We've embarked on a project to migrate all of our live data into RDS. We operate 24/7/365 and must maximize availability of our systems. Since Postgres is at the core of everything we do, database downtime is not an option. This presentation will step through our experience migrating our production database into RDS. We aren't experts, but we have strict requirements. We will present our approach to the migration, the results, what lessons we learned along the way, and a number of comparative measurements. http://www.pgconf.us/2016/event/152/migrating-a-live-postgres-database-into-rds-with-no-downtime-experiences-and-lessons-learned/
Views: 613 Postgres Conference
Event-driven systems with Postgres and PgQ
Check out http://www.pgconf.us/2015/event/81/ for the full talk details. PgQ provides an extremely convenient mechanism for Postgres developers to efficiently create durable, transactional messages for asynchronous processing. In this talk, we discuss in detail how to effectively use PgQ to power event-driven systems in your infrastructure. About the Speaker Dave is a developer at Braintree in Chicago, where he has worked on a variety of products since 2011. He particularly enjoys working with Postgres and other data-oriented systems.
Views: 1614 Postgres Conference
Deploying and Managing PostgreSQL with Ansible  David Hollenberger mp4
PostgreSQL environments can quickly become very complex. Master/slave replication for disaster recovery. Barman to manage backups and WAL archiving. PGBouncer for load balancing and reduce downtime during upgrades and migrations. The list can go on and on. Ansible is a very simple and powerful open source configuration management tool distributed under the GNU General Public License that allows us to deploy and manage our PosgresQL environments as a complete stack. Using Ansible's built in PostgreSQL modules we are able to define our database infrastructure as code. We also use Ansible to orchestrate the installation and configuration of all the other components we need for our PostgreSQL environment. http://www.pgconf.us/2016/event/158/deploying-and-managing-postgresql-with-ansible/
Views: 783 Postgres Conference
PostgreSQL Performance Presentation (9.5devel edition)
Check out http://www.pgconf.us/2015/event/89/ for the full talk details. This presentation will take a look at the performance changes in the development version of PostgreSQL. A selection of features, some proposed and some already committed, are evaluated using synthetic open source workloads. One of the workloads used is the former OSDL's Database Test 3 that consists of business oriented ad-hob queries with concurrent data modification. Some of these proposed features include: - New index type called Block Range Indexes (BRIN) - Improvements to the buffer cache management - Improvements to the data lock management - Other internal data structure changes About the Speaker Simon works as an Architect and Developer of new features for PostgreSQL, setting technical directions for 2ndQuadrant and as a Database Systems Architect for 2ndQuadrant customers. Simon is the author of PostgreSQL 9 Admin Cookbook.
Views: 2389 Postgres Conference
Check out http://www.pgconf.us/2015/event/97/ for the full talk details. In this talk I'm going to touch different techniques and tools for managing changes inside PostgreSQL databases, including schema deployments, data changes and usage of stored procedures as a versioned API layer. Based on my experience of no-downtime deployments at Zalando SE, one of the biggest European fashion retailers, I'm going to highlight different approaches to database deployments and introduce some open-source tools used and developed by the Database Team at Zalando. About the Speaker Alexey started with PostgreSQL at 2003 as a C programmer. He learned how to debug the backend code before learning SQL, but caught up on the latter pretty quickly. He is now using both of those skills and years of experience as a database consultant to help his employer manage a growing number of PostgreSQL database clusters and deal with hundreds of database changes during weekly deployments. A native of Simferopol, Ukraine, he lives in Berlin and works as a Database Engineer at Zalando SE. Over the years, he contributed code and documentation to the PostgreSQL project.
Views: 252 Postgres Conference
Programming the SQL Way with Common Table Expressions  Bruce Momjian mp4
SQL is a declarative language, meaning the user submits an SQL command and the database determines the optimal execution. Common Table Expressions (CTEs) allow queries to be more imperative, allowing looping and processing hierarchical structures that are normally associated only with imperative languages. This talk will help developers use implement CTE queries in their applications and allow operations that normally could only be done in application code to be done via SQL queries. http://www.pgconf.us/2016/event/194/programming-the-sql-way-with-common-table-expressions/
Views: 375 Postgres Conference
Top 10 Problems Solved by PostGIS Leo Hsu
We'll cover 10 problems where we've found PostGIS to be the easiest and fastest tool for the job. Areas covered will be: Proximity Analysis Statistical aggregation of data by location Mapping Routing Geocoding Unlikely uses for PostGIS -- non-spatial problems solved by re-imagining the problem as a spatial one. http://www.pgconf.us/2016/event/122/top-10-problems-solved-by-postgis/
Views: 588 Postgres Conference
Managing PostgreSQL with Puppet
Check out http://www.pgconf.us/2015/event/56/ for the full talk details. Puppet has quickly become a popular tool for management of infrastructure. The Puppet Labs team provides an official puppet module for managing PostgreSQL installations. This excellent module provides documentation for patterns that are very straight forward for simple implementations. However, for service-oriented architecture where many applications share a database and disparate environments are prolific, PostgreSQL management becomes more complex. This talk will review the use cases of the Puppet Labs module and how it can be leveraged to build complex application and database environments. Using an overview of the Puppet Lab's module, we'll review how CoverMyMeds implemented additional automation for things like master/slave awareness, database, role and grant management and environment-specific configuration. About the Speaker Chris Everest is currently a Systems Operations Engineer at CoverMyMeds, Inc. Chris has more than a decade of professional experience in large-scale enterprises, where the main theme is the enablement of client-server applications. He's especially comfortable in the open source world, where passion is sparked by the Linux platform and automation of server configuration. Chris' other positions have included SourceForge/Slashdot Media and Abbott Laboratories where full-stack operations; networks, servers, databases and applications have all lent to his technical knowledge.
Views: 524 Postgres Conference
PostgreSQL - Community meets Business
This presentation shows why the software created by the PostgreSQL community is (one of) the most important pieces of Open Source for business users. It gives some motivations for the immense growth in enterprise space PostgreSQL experienced in recent years. With PostgreSQL not only fulfilling the technical requirements, but also the operations requirements it quickly became a strategical choice for a lot of companies, be it for internal IT or one of the database systems of choice that are supported by their own product. About the Speaker Michael Meskes is President and CEO of the credativ Group, an industry leader in free software services with offices in five countries. Its Open Source Support Centers employ leading members of a number of Open-Source projects. He has been Open-Source developer for twenty years working on different Open-Source projects among which Debian and PostgreSQL are most widely known. He also has done a lot of Open-Source related presentations on all sorts of events doing a lot of Open-Source evangelism.
Views: 135 Postgres Conference
Parallel Query In PostgreSQL  Robert Haas
I and others have been working on bringing parallel query for PostgreSQL for several years now, but PostgreSQL 9.6 is the first release expected to include a user-visible feature. And it's pretty cool. In this talk, I'll give an overview of the development of this feature, where we are now, and what the future might hold. I will discuss the overall architecture of parallelism in PostgreSQL, give examples of queries that can be accelerated by the features expected to be in PostgreSQL 9.6, and talk about what's not done yet. http://www.pgconf.us/2016/event/147/parallel-query-in-postgresql/
Views: 1423 Postgres Conference
cstore_fdw: Columnar store for PostgreSQL
Check out http://www.pgconf.us/2015/event/69/ for the full talk details. Column oriented data stores bring notable performance advantages for analytic workloads; and they have gained popularity as part of proprietary database solutions in the past few years. cstore_fdw is an open source columnar store for PostgreSQL. The extension follows the same data layout as Facebook's Optimized Row Columnar (ORC) format, and brings the following benefits: * Compression: Reduces the on-disk data size by 2-4x * Column Projections: Only read column data relevant to query, improves the performance for I/O bound queries * Skip Indexes: Keeps min/max statistics for row groups and uses them to skip over unrelated rows. About the Speaker Ozgun is a co-founder and the CTO at Citus Data. Prior to Citus, Ozgun worked as a software developer for four years in the Distributed Systems Engineering team at Amazon. There, he proposed, designed, and implemented novel algorithms on distributed caching and consistency; and also worked on building systems for scalable data analytics. Ozgun earned his M.S. in Computer Science from Stanford University, and his B.S. from Galatasaray University. He also holds patents on distributed cache consistency and load balancing.
Views: 599 Postgres Conference
Using PostgreSQL to manage ArcGIS spatial data
The objective of this presentation is to show the effective use of PostgreSQL to manage Geographic Information System data (hereby referred to as GIS). The bulk of the data for Mecklenburg County, NC is edited and created with the use of ESRI‘s ArcGIS software. However, in the recent years the county has made a bold switch from SQL server to PostgreSQL for the backend database. This was a very challenging decision since we were one of the first in the country to make this switch. This was evident three years ago; during the ESRI International User Conference when there were only six people attending the session titled “Database Administration with PostgreSQL”. There was next to little documentation or help available either online or over the phone. Mecklenburg County had decided to maintain the production GIS databases with the help of ESRI’s SDE and PostgreSQL. Most of the data we receive comes from SQL server. The ETL packages which were in SSIS had to be rebuilt in Kettle. http://www.pgconf.us/2016/event/136/postgresql-and-arcgis-plus-arcgis-pl-python-analytics/
Views: 878 Postgres Conference
Over the fifo and Through psql to PostgreSQL We Go: Migrating from Sybase to Postgres
Check out http://www.pgconf.us/2015/event/101/ for the full talk details. A journey from Sybase to PostgreSQL--a process of working around Sybase's quirks and peculiarities with a few detours and dead ends along the way, to eventual success. Shell and python scripts available. About the Speaker As a card carrying member of the Professional Organization of English Majors, my own journey includes too many years behind the wheel of a semi to being the entire IT department for a non-profit in Wyoming and Montana to DBA at Command Prompt. I'm an avid amateur astronomer, bee keeper and into my 40th year of keeping and using a sourdough starter.
Views: 113 Postgres Conference
PostgreSQL Monitoring  Kevin Kempter
A walk through of monitoring PostgreSQL database clusters to include: Relevant PostgreSQL system catalog metrics Relevant contribs / extensions PostgreSQL log parsers PostgreSQL performance troubleshooting Performance tuning methods http://www.pgconf.us/2016/event/117/postgresql-monitoring/
Views: 456 Postgres Conference
Choosing a Logical Replication System
Check out http://www.pgconf.us/2015/event/96/ for the full talk details. This talk covers some of the high-level issues involved in choosing a specific logical replication system for use with PostgreSQL. We cover some of the differences between physical and logical replication and go into depth on the functioning of some of the available logical replication systems (Slony and Bucardo specifically) and cover strengths for each of these with example use-cases. We will also review some of the new PostgreSQL 9.4 infrastructure available for logical replication systems. About the Speaker David Christensen is a software developer for End Point corporation and works remotely from Lawrence, KS. He has a wide knowledge of database platforms and is the leader of End Point’s PostgreSQL team. He has a B.S. in Mathematics from the University of Kansas and worked for the Kansas Center for Educational Testing and Evaluation before joining End Point in 2006.
Views: 407 Postgres Conference
Practical Lessons Learned when using PostgreSQL at a Web Startup  Lukas Fittl
PostgreSQL is a great database - yet there is an interesting set of issues you encounter when you have a team of developers working with an ever changing schema. At Product Hunt we've been using PostgreSQL as the main database since our launch in 2013 - and since then have encountered many smaller problems that we've had to deal with as we've grown, as well as making sure we get close to 100% uptime on our Postgres DB. This session is about the lessons learned, and will go into issues like: Exclusive locks held during DB schema changes, making zero downtime schema changes, choosing what to index, problems encountered with Ruby on Rails and its use of prepared statements, and more. http://www.pgconf.us/2016/event/124/practical-lessons-learned-when-using-postgresql-at-a-web-startup/
Views: 437 Postgres Conference
Enterprise Grade Deployment and Security with PostgreSQL
Check out http://www.pgconf.us/2015/event/87/ for the full talk details. The talk will include how we are using PostgreSQL in the production environment at Inmobi . Following are the key-points: * PostgreSQL as the main transactional master DB with 99% uptime * Automated way to implement in production (with puppet) * Replication via cascaded SR in multiple data center * Readonly DB load balancing on multiple nodes in each data centre * Pgbouncer pooling *Security control via pg_hba *Customer Interface reporting db
Views: 400 Postgres Conference
Ranges, Partitioning and Limitations  Corey Huinker mp4
Range types are one of the things that truly sets PostgreSQL apart from other databases, but they are underused, and the functionality around them is not complete. This talk will go into some of those limitations (lack of a text range type, some missing operators etc) which the extension range_type_functions attempts to bridge. http://www.pgconf.us/2016/event/142/ranges-partitioning-and-limitations/
Views: 146 Postgres Conference
How Tencent uses Postgres XC for their high volume WeChat payment system  Jasonys Li mp4
Tencent, based in China, is one of the world's largest companies in the social networking space. This talk discusses how Tencent modified the code of Postgres-XC to meet their internal payment system requirements. http://www.pgconf.us/2016/event/148/how-tencent-uses-postgres-xc-for-their-high-volume-wechat-payment-system/
Views: 265 Postgres Conference
MLS PostgreSQL Implementing Multi level Security in PostgreSQL with RLS and SELinux  Joe Conway mp4
PostgreSQL 9.5 has a new feature called Row Level Security (RLS). Using RLS, a PostgreSQL extension called sepgsql (somewhat modified), and Security Enhanced Linux (SELinux) configured properly, it is possible to create a Multi-level Security database. This talk will describe how it can be done. http://www.pgconf.us/2016/event/138/mls-postgresql-implementing-multi-level-security-in-postgresql-with-rls-and-selinux/
Views: 307 Postgres Conference
Overcoming First Principles  A guide for accessing the features of PostgreSQL in test driven develop
Effective unit testing requires a software designer to define a set of abstractions which will comprise a particular system. If unit tests become brittle obstacles to refactoring or ineffective in providing design insight, then the approach we use for testing must be revised. In this talk we will explore methods of treating PostgreSQL as a runtime component of your application and not as an external service. The end goal will be to learn to write tests that neatly capture units of functionality which depend on an SQL engine. http://www.pgconf.us/2016/event/126/overcoming-first-principles-a-guide-for-accessing-the-features-of-postgresql-in-test-driven-development/
Views: 139 Postgres Conference
PostgreSQL High Availability and Geographic Locality using consul  Sean Chittenden
Provide an introduction and setup for consul as the means of providing highly available PostgreSQL in local and geographically disparate data centers or cloud providers. This talk will include: *) Introduction to consul and its architecture *) Setup of a single consul cluster *) Setup for a few sample database instances (OLAP and OLTP) *) Firewall requirements *) Integration with bind, djbdns, and dnsmasq *) Setup geographic failover to two different data centers and cloud providers *) Various Best Practices tips and suggestions *) Q&A http://www.pgconf.us/2016/event/157/postgresql-high-availability-and-geographic-locality-using-consul/
Views: 752 Postgres Conference

Pregnancy loss australia newsletter formats
Uk passport cover letter
Non disclosure agreement cover letter template
Merchandising assistant cover letter examples
Yale cover letter examples