Software Engineering

Software Engineering Daily

Software Engineering Daily

+92 FANS

Technical interviews about software topics.

Looking for recently uploaded episodes
React and GraphQL at New York Times

58:15 | Nov 30th, 2017

Are we a media company or a technology company? Facebook and the New York Times are both asking themselves this question. Facebook originally intended to focus only on building technology–to be a neutral arbiter of information. This has turned out to...Show More

Animating VueJS with Sarah Drasner

53:18 | Dec 1st, 2017

Most user interfaces that we interact with are not animated. We click on a button, and a form blinks into view. We click a link and the page abruptly changes. On the other hand, when we interact with an application that has animations, we can feel th...Show More

Kafka at NY Times with Boerge Svingen

1:01:19 | Oct 30th, 2017

The New York Times is a newspaper that evolved into a digital publication. Across its 166 year history, The Times has been known for longform journalistic quality, in addition to its ability to quickly churn out news stories. Some content on the New ...Show More

ReactVR with Andrew Imm

1:06:31 | Oct 2nd, 2017

React is a programming model for user interfaces. ReactJS is for building user interfaces for web applications. React Native is for building UI on Android or iOS. ReactVR is for building user interfaces in virtual reality. React Native was originally...Show More

iOS and Podcasts with Rob Walch

1:17:25 | May 30th, 2017

Apple controls the iOS ecosystem. As an accident of history, Apple also controls the podcasting ecosystem. Unlike most ecosystems within Apple’s dominion, podcasts remain open. A podcaster merely has to record an mp3, distribute it via RSS feed, and ...Show More

PlanetScale: Sharded Database Management with Jiten Vaidya and Dan Kozlowski

1:00:28 | Feb 21st

In the early days of YouTube, there were scalability problems with the MySQL database that hosted the data model for all of YouTube’s videos. The state of the art solution to scaling MySQL at the time was known as “application-level sharding.” To sca...Show More

Zoox Self-Driving with Ethan Dreyfuss

1:03:04 | Feb 20th

Zoox is a full-stack self-driving car company. Zoox engineers work on everything a self-driving car company needs, from the physical car itself to the algorithms running on the car to the ride hailing system which the company plans to use to drive ar...Show More

Store2Vec: DoorDash Recommendations with Mitchell Koch

49:36 | Feb 19th

DoorDash is a food delivery company where users find restaurants to order from. When a user opens the DoorDash app, the user can search for types of food or specific restaurants from the search bar or they can scroll through the feed section and look...Show More

Policy Enforcement with Shimon Tolts

1:00:44 | Feb 18th

The nature of software projects is changing. Projects are using a wider variety of cloud providers and SaaS tools. Projects are being broken up into more git repositories, and the code in those repositories are being deployed into small microservices...Show More

Ethsimple: Ethereum Tools with Brian Soule

1:27:59 | Feb 15th

Ethereum allows developers to run decentralized applications. But the tooling for building and managing those decentralized applications is immature. Experienced software engineers have difficulty getting started with writing Ethereum applications be...Show More

Kubernetes Security with Liz Rice

54:36 | Feb 14th

A Kubernetes cluster presents multiple potential attack surfaces: the cluster itself, a node running on the cluster, a pod running in the node, a container running in a pod. If you are managing your own Kubernetes cluster, you need to be aware of the...Show More

Replicated: On-Prem Deployments with Grant Miller

1:03:06 | Feb 13th

Cloud computing has been popular for less than twenty years. Large software companies have existed for much longer. If your company was started before the cloud became popular, you probably have a large, data center on your companies premises. The sh...Show More

Uber’s Monitoring Platform with Rob Skillington

59:31 | Feb 12th

Uber manages the car rides for millions of people. The Uber system must remain operational 24/7, and the app involves financial transactions and the safety of passengers. Uber infrastructure runs across thousands of server instances and produce terab...Show More

Pachyderm: Data Pipelines with Joe Doliner

1:09:36 | Feb 11th

Data infrastructure is advancing beyond the days of Hadoop MapReduce, single-node databases, and nightly reporting. Companies are adopting modern data warehouses, streaming data systems, and cloud-specific data tools like BigQuery. Every company with...Show More

Knative: Serverless Workloads with Ville Aikas

59:08 | Feb 8th

Infrastructure software is having a renaissance. Cloud providers offer a wide range of deployment tools, including virtual machines, managed Kubernetes clusters, standalone container instances, and serverless functions. Kubernetes has standardized th...Show More

VMware Kubernetes Strategy with Brad Meiseles

51:07 | Feb 7th

Virtualization software allows companies to get better utilization from their physical servers. A single physical host can manage multiple virtual machines using a hypervisor. VMware brought virtualization software to market, creating popular tools f...Show More

Cadre: Automated Investing with Leonid Movsesyan

1:02:11 | Feb 6th

Real estate is an asset that is not straightforward to invest in. Real estate can generate excellent returns for investors, but can require much more time and expertise than stocks. Cadre is a company that allows users to invest in real estate more e...Show More

RocksDB with Dhruba Borthakur and Igor Canadi

1:06:07 | Feb 5th

RocksDB is a storage engine based on the log structured merge tree data structure. RocksDB was developed at Facebook to provide a tool for embedded databases. The code for RocksDB is a fork of LevelDB, an embedded database built by Google for the Chr...Show More

Scaling Hashicorp with Armon Dadgar and Mitchell Hashimoto

58:04 | Feb 4th

Hashicorp was founded seven years ago with the goal of building infrastructure tools for automating cloud workflows such as provisioning, secret management, and service discovery. Hashicorp’s thesis was that operating cloud infrastructure was too har...Show More

Engineering Philosophy with Tyler Cowen

1:04:48 | Feb 1st

Tyler Cowen’s book Stubborn Attachments outlines a framework that individuals can use to make decisions grounded in economic philosophy. In his previous books, Tyler examined recent economic history. Stubborn Attachments gives his perspective for nav...Show More

Architects of Intelligence with Martin Ford

1:04:31 | Jan 31st

Artificial intelligence is reshaping every aspect of our lives, from transportation to agriculture to dating. Someday, we may even create a superintelligence–a computer system that is demonstrably smarter than humans. But there is widespread disagree...Show More

Anatomy of Next: New World with Mike Solana

1:10:35 | Jan 30th

Mars is a cold, inhospitable planet far from earth. It presents one of the most complex challenges faced by engineers: how can we create a new world? To create a new world, first we have to get there. We can build new rockets with improved propulsion...Show More

Likewar: The Weaponization of Social Media with P.W. Singer

59:39 | Jan 29th

Social media has transformed our lives. It has also transformed how wars are fought. P.W. Singer’s new book “Likewar: The Weaponization of Social Media” describes the far-reaching impact of social media on the tactics and strategies used by military,...Show More

Software Chasms with Martin Casado

1:04:02 | Jan 28th

Infrastructure software can be a great business. An infrastructure software company sells core technology to a large enterprise such as a bank or insurance company. This software has near zero marginal cost and generates a large annuity for the infra...Show More

Kubeflow: TensorFlow on Kubernetes with David Aronchick

1:02:33 | Jan 25th

When TensorFlow came out of Google, the machine learning community converged around it. TensorFlow is a framework for building machine learning models, but the lifecycle of a machine learning model has a scope that is bigger than just creating a mode...Show More

TiDB: Distributed NewSQL with Kevin Xu

1:12:27 | Jan 24th

When a user interacts with an application to order a ride with a ridesharing app, the data for that user interaction is written to a “transactional” database. A transactional database is a database where specific rows need to be written to and read f...Show More

Storybook: UI Engineering with Zoltan Olah

55:24 | Jan 23rd

React, Vue, and Angular are the most popular frontend JavaScript frameworks. Each of these frameworks lets frontend developers build components. A component is a high level visual abstraction that is used to compose a user interface. Frontend develop...Show More

RSocket: Reactive Streaming Service Networking with Ryland Degnan

1:06:04 | Jan 22nd

Netflix has thousands of service instances communicating with each other. When a Netflix client on a smartphone makes a request for a movie, that request hits Netflix’s backend, where the request is fulfilled by a chain of requests through different ...Show More

Prometheus Scalability with Bryan Boreham

53:24 | Jan 21st

Prometheus is an open source monitoring system and time series database. Prometheus includes a multi-dimensional data model, a query language called PromQL, and a pull model for gathering metrics from your different services. Prometheus is widely use...Show More

Spot Instances with Amiram Shachar

1:05:40 | Jan 18th

When a developer provisions a cloud server, that server is called an “instance”. These instances can be used for running whatever workload a developer has, whether it is a web application, a database, or a set of containers. The cloud is cheap to get...Show More

Looker: Business Intelligence Platform with Daniel Mintz

1:09:17 | Jan 17th

If a business has been operating successfully for a few years, that business has accumulated a high volume of data. That data exists in spreadsheets, CSV files, log files, and balance sheets. Data might be spread across local files on a user’s laptop...Show More

Human Sized Robots with Zach Allen

53:08 | Jan 16th

Robots are making their way into every area of our lives. Security robots roll around industrial parks at night, monitoring the area for intruders. Amazon robots tirelessly move packages around in warehouses, reducing the time and cost of logistics. ...Show More

Notebooks at Netflix with Matthew Seal

1:05:23 | Jan 15th

Netflix has petabytes of data and thousands of workloads running across that data every day. These workloads generate movie recommendations for users, create dashboards for data analysts to study, and reshape data in ETL jobs, to make it more accessi...Show More

Kubernetes in China with Dan Kohn

59:21 | Jan 14th

Chinese Internet companies operate at a massive scale. WeChat has over a billion users and is widely used as the primary means of payment by urban Chinese consumers. Alibaba ships 12 million packages per day, which is four times the amount of Amazon....Show More

AWS Analysis with Corey Quinn

1:06:09 | Jan 11th

Amazon Web Services changed how software engineers work. Before AWS, it was common for startups to purchase their own physical servers. AWS made server resources as accessible as an API request, and has gone on to create higher-level abstractions for...Show More

Zeit: Serverless Cloud with Guillermo Rauch

1:11:03 | Jan 10th

Serverless computing is a technique for deploying applications without an addressable server. A serverless application is running on servers, but the developer does not have access to the server in the traditional sense. The developer is not dealing ...Show More

Cloud Events with Doug Davis

54:15 | Jan 9th

Functions-as-a-service allow developers to run their code in a “serverless” environment. A developer can provide a function to a cloud provider and the code for that function will be scheduled onto a container and executed whenever an event triggers ...Show More

Multicloud with Ben Hindman

1:12:42 | Jan 8th

Most applications today are either deployed to on-premise environments or deployed to a single cloud provider. Developers who are deploying on-prem struggle to set up complicated open source tools like Kafka and Hadoop. Developers who are deploying t...Show More

Stateful Kubernetes with Saad Ali

1:00:08 | Jan 7th

In a cloud infrastructure environment, failures happen regularly. The servers can fail, the network can fail, and software bugs can crash your software unexpectedly. The amount of failures that can occur in cloud infrastructure is one reason why stor...Show More

Kong API Platform with Marco Palladino

1:03:16 | Jan 4th

When a user makes a request to product like The New York Times, that request hits an API gateway. An API gateway is the entry point for an external request. An API gateway serves several purposes: authentication, security, routing, load balancing, an...Show More

Ubiquity6: Augmented Reality Platform with Ankit Kumar

57:31 | Jan 3rd

Augmented reality glasses will let us walk through a world where the digital blends together with the physical. 3-D objects will be rendered and superimposed onto our field of vision, creating an environment for people to build applications we can ha...Show More

Crossplane: Multicloud Control Plane with Bassam Tabbara

58:37 | Jan 2nd

Cloud providers created the ability for developers to easily deploy their applications to servers on data centers. In the early days of the cloud, most of the code that a developer wrote for their application could run on any cloud provider, whether ...Show More

Word2Vec with Adrian Colyer Holiday Repeat

1:01:47 | Dec 28th, 2018

Originally posted on 13 September 2017. Machines understand the world through mathematical representations. In order to train a machine learning model, we need to describe everything in terms of numbers.  Images, words, and sounds are too abstract fo...Show More

Self-Driving Deep Learning with Lex Fridman Holiday Repeat

59:05 | Dec 27th, 2018

Originally posted on 28 July 2017. Self-driving cars are here. Fully autonomous systems like Waymo are being piloted in less complex circumstances. Human-in-the-loop systems like Tesla Autopilot navigate drivers when it is safe to do so, and lets the...Show More

Technology Utopia with Michael Solana Holiday Repeat

48:51 | Dec 26th, 2018

Originally posted on 1 May 2018. Technology is pushing us rapidly toward a future that is impossible to forecast. We try to imagine what that future might look like, and we can’t help having our predictions shaped by the media we have consumed. 1984,...Show More

Google Early Days with John Looney Holiday Repeat

1:11:02 | Dec 25th, 2018

Originally posted on 16 June 2017. John Looney spent more than 10 years at Google. He started with infrastructure, and was part of the team that migrated Google File System to Colossus, the successor to GFS. Imagine migrating every piece of data on G...Show More

Service Proxying with Matt Klein Holiday Repeat

56:18 | Dec 24th, 2018

Originally posted on 14 February 2017. Most tech companies are moving toward a highly distributed microservices architecture. In this architecture, services are decoupled from each other and communicate with a common service language, often JSON over...Show More

Rockset Data Platform with Venkat Venkataramani

59:16 | Dec 21st, 2018

At Facebook, Venkat Venkataramani saw how large volumes of data were changing software infrastructure. Applications such as logging servers and advertising were creating fast moving, semi-structured data. The user base was growing, the traffic was gr...Show More

Modern Front End: React, GraphQL, VR, WebAssembly with Adam Conrad

1:06:00 | Dec 20th, 2018

Ten years ago, there was a distinction between “backend” and “frontend” developers. A backend developer would be managing the business logic and database transactions using Ruby on Rails or Java. A frontend developer would be responsible for implemen...Show More

Linkerd Service Mesh with William Morgan

1:00:22 | Dec 19th, 2018

Software products are distributed across more and more servers as they grow. With the proliferation of cloud providers like AWS, these large infrastructure deployments have become much easier to create. With the maturity of Kubernetes, these distribu...Show More

Market Strategy with Herb Cunitz

1:02:41 | Dec 18th, 2018

Market strategy defines how a company is positioning itself to be successful. This strategy encompasses engineering, sales, marketing, recruiting, and everything else within a company. Herb Cunitz has led teams at Hortonworks, VMware, SpringSource, a...Show More

Mattermost: Self-Hosted Slack Alternative with Corey Hulen

1:03:16 | Dec 17th, 2018

Software companies today rely on group chat applications. The world of startups and small businesses is dominated by Slack. But for some large enterprises, regulatory constraints prevent them from using Slack. Slack is a web application that is hoste...Show More

Plaid: Banking API Platform with Jean-Denis Greze

1:03:04 | Dec 13th, 2018

A bank account is a platform for apps to be built on top of. If that sounds like a weird idea, think about the features of a bank account. Most users only have a single bank account, making it a tool for identity and authentication. The series of tra...Show More

High Growth Handbook with Elad Gil

58:15 | Dec 12th, 2018

When a startup finds product market fit, the adoption of that product can grow rapidly, turning a startup into a high growth company. All of a sudden, a startup that was struggling to find its first customer is bombarded with new challenges. The star...Show More

Feature Flags with Edith Harbaugh

35:07 | Dec 11th, 2018

Releasing software has inherent risk. If your users don’t like your new feature, they might stop using your product immediately. If a software bug makes it into production, it can crash your entire application. Releasing software gradually has many b...Show More

Serverless Research with Ion Stoica

1:11:02 | Dec 10th, 2018

The Berkeley AMPLab was a research lab where Apache Spark and Apache Mesos were both created. In the last five years, the Mesos and Spark projects have changed the way infrastructure is managed and improved the tools for data science. Because of its ...Show More

Technical Investing with Sunil Dhaliwal

1:01:38 | Dec 7th, 2018

Robotics, genomics, and backend infrastructure: as an in vestor, it can be difficult to assess the viability of a startup that is on the cutting edge in any of these areas. A robotics startup requires a team with an integrated understanding of hardwa...Show More

Bitcoin Payment Channels with Alex Bosworth

1:00:44 | Dec 5th, 2018

The Bitcoin main chain is a large distributed ledger of transactions. Bitcoin is useful for maintaining a trusted record of payments, but is not practical for small day-to-day payments. Bitcoin payment channels allow users to issue small payments to ...Show More

Streaming Platform Architecture with Luca Mezzalira and Yan Cui

51:54 | Dec 4th, 2018

Demand for live streaming video over the internet is increasing. After the emergence of early live streaming platforms, like Twitch and Facebook Live, more forms of video have become accessible over live streams, such as sports. Live streaming is a h...Show More

On-Prem Cloud with Bob Fraser

1:00:49 | Dec 3rd, 2018

Not every company wants to move to the public cloud. Some companies have already built data centers, and can continue to operate their business with their own servers. Some companies have compliance issues with the public cloud, and want to operate t...Show More

Anchor: Podcast Platform with Nir Zicherman

58:17 | Nov 30th, 2018

Podcasts have surged in popularity, but the podcast ecosystem remains difficult to work with. Podcast listeners have difficulty finding episodes. Podcast creators have difficulty finding out how to get started. The advertising marketplaces for podcas...Show More

Cloud Costs with Ran Rothschild

57:52 | Nov 29th, 2018

Cloud computing changed the economics of running a software company. Before the cloud, a software company had to purchase physical machines which often required thousands of dollars paid up front. The cloud allowed developers to deploy their applicat...Show More

Slack Messaging Architecture with Keith Adams

1:01:59 | Nov 28th, 2018

Slack is a real-time messaging system for work communication. On Slack, chat rooms as big as 100,000 people have productive conversations. This might sound like the same problem solved by social networks like Facebook, where billions of users communi...Show More

Facet Wealth Engineering with Gorkem Sevinc

1:00:37 | Nov 27th, 2018

Many people have saved some money which they want to invest for the future. Some people are happy investing their money in a roboadviser, which programmatically puts money into long-term investments. Other people want a more personal approach involvi...Show More

Parity: Blockchain Infrastructure with Gavin Wood

55:15 | Nov 26th, 2018

Parity is a company that builds blockchain infrastructure. Parity has built several open source projects and works with enterprises to put blockchain technology in production. Gavin Wood is the founder of Parity, and he joins the show to talk about t...Show More

Death and Distributed Systems with Pieter Hintjens Holiday Repeat

1:03:15 | Nov 23rd, 2018

Originally posted on June 23, 2016. Pieter Hintjens grew up writing software by himself. The act of writing code brought him great pleasure, but the isolated creative process disconnected him from the rest of the world. As his life progressed he beca...Show More

Algorithms to Live By with Brian Christian Holiday Repeat

58:09 | Nov 22nd, 2018

Originally posted on May 12, 2016. When you are deciding who to marry, you are using an algorithm. The same is true when you are looking for a parking space, playing a game of poker, or deciding whether or not to organize your closet. Algorithms To L...Show More

Poker Artificial Intelligence with Noam Brown Holiday Repeat

55:38 | Nov 21st, 2018

Originally posted on May 12, 2015. Humans have now been defeated by computers at heads up no-limit holdem poker. Some people thought this wouldn’t be possible. Sure, we can teach a computer to beat a human at Go or Chess. Those games have a smaller d...Show More

Salary Negotiation with Haseeb Qureshi Holiday Repeat

1:34:58 | Nov 20th, 2018

Featured Image Photo Credits Originally posted on July 11, 2016. Negotiation is an important skill for software engineers. The salary you negotiate at the beginning of your job could be a difference of tens of thousands of dollars over the course of ...Show More

Schedulers with Adrian Cockcroft Holiday Repeat

58:08 | Nov 19th, 2018

Originally published on July 6, 2016. Scheduling is the method by which work is assigned to resources to complete that work. At the operating system level, this can mean scheduling of threads and processes. At the data center level, this can mean sch...Show More

Reflow: Distributed Incremental Processing with Marius Eriksen

1:12:56 | Nov 16th, 2018

The volume of data in the world is always increasing. The costs of storing that data is always decreasing. And the means for processing that data is always evolving. Sensors, cameras, and other small computers gather large quantities of data from the...Show More

Liquid Software with Baruch Sadogursky

59:40 | Nov 15th, 2018

The software release process is a barrier between written code and a live production environment that affects users. A software release process can involve a variety of different practices. Code might be tested for bugs using automation and manual te...Show More

SPIFFE: Zero Trust Workload Identification with Evan Gilman

59:54 | Nov 14th, 2018

Modern software consists of sprawling international networks of servers. Users contact these servers to access applications. Microservices talk to each other to fulfill complicated requests. Databases and machine learning frameworks crunch terabytes ...Show More

Fission: Serverless on Kubernetes with Soam Vasani

1:03:05 | Nov 13th, 2018

Serverless computing abstracts away the idea of a server node. Serverless lets programmers treat compute resources as high-level, reliable APIs, rather than unreliable, low-level compute nodes that might fail. Serverless dramatically improves the eff...Show More

Open Policy Agent with Torin Sandall

58:55 | Nov 12th, 2018

Policies define which users and applications can access and modify resources in a computer system. In a file system, a user might have permission to read or write to a file. In a cloud infrastructure deployment, a user might have the rights to deploy...Show More

TLA+ with Leslie Lamport

36:04 | Nov 9th, 2018

TLA+ is a formal specification language. TLA+ is used to design, model, and verify concurrent systems. TLA+ allows a user to describe a system formally with simple, precise mathematics. TLA+ was designed by Leslie Lamport, a computer scientist and Tu...Show More

Computer Vision with Peter Kontschieder

1:01:30 | Nov 8th, 2018

Mapillary is a company that processes high volumes of images to develop a labeled 3-D model of the physical world. Mapillary’s APIs allow developers to build applications that are aware of stop signs, buildings, streets, trees, and other physical obj...Show More

Computer Architecture with Dave Patterson

51:07 | Nov 7th, 2018

An instruction set defines a low level programming language for moving information throughout a computer. In the early 1970’s, the prevalent instruction set language used a large vocabulary of different instructions. One justification for a large ins...Show More

OSS Capital with Joseph Jacks

1:03:46 | Nov 6th, 2018

Open source projects benefit from the network effects of a large audience of developers. A popular open source project will be contributed to and used by thousands of developers, who are continuously testing, deploying, and improving the software. Th...Show More

Commons Clause with Kevin Wang

1:03:37 | Nov 5th, 2018

Open source software powers everything we do on the Internet. Google runs on Linux servers. Content sites are served by WordPress. Our data is queued in Kafka clusters and stored in MongoDB instances. The success of an open source project often leads...Show More

Scaling Lyft with Matt Klein

57:47 | Nov 2nd, 2018

Matt Klein has worked for three rapidly growing Internet companies. At AWS, he worked on EC2, the compute-as-a-service product that powers a large percentage of the Internet. At Twitter, he helped scale the infrastructure in the chaotic days before T...Show More

Wonolo: Staffing Marketplace with Jeremy Burton

56:51 | Nov 1st, 2018

Online labor marketplaces are widely used for one-to-one transactions. On Uber, a rider hires a driver for transportation. On TaskRabbit, a homeowner hires a cleaner to come clean their kitchen. These types of marketplaces are not as widely used for ...Show More

Diffbot: Knowledge Graph API with Mike Tung

57:43 | Oct 31st, 2018

Google Search allows humans to find and access information across the web. A human enters an unstructured query into the search box, the search engine provides several links as a result, and the human clicks on one of those links. That link brings up...Show More

Drift: Sales Bot Engineering with David Cancel

1:00:09 | Oct 30th, 2018

David Cancel has started five companies, most recently Drift. Drift is a conversational marketing and sales platform. David has a depth of engineering skills and a breadth of business experience that make him an amazing source of knowledge. In today’...Show More

Building a Hiring Process with Ammon Bartram

54:44 | Oct 29th, 2018

Engineers who start companies often find themselves building something they have no experience with: a hiring process. Hiring engineers today is not as systematic as building software. We don’t have lots of data that tells us what makes for an effect...Show More

Gig Economy

53:34 | Oct 28th, 2018

I like to write music, and a year ago I started working on an album called “Gig Economy”. The plan for the album was to hire musicians from gig economy platforms like Fiverr and Upwork to perform on songs that I produced. The album is finished and I’...Show More

Blockchain Distribution Network with Aleksandar Kuzmanovic

1:18:25 | Oct 26th, 2018

Cryptocurrencies are not very usable today. The main use cases for cryptocurrencies today are store of value (somewhat like gold) and speculation. One reason that the use cases are so narrow is the problem of scalability. Cryptocurrencies have severa...Show More

Flogo: Event-Driven Ecosystem with Leon Stigter and Matt Ellis

52:16 | Oct 25th, 2018

A smart security camera takes in a high volume of video images and processes those images using a set of machine learning models. Those models can be used to identify interesting snippets of movement throughout the day, and decide which of those snip...Show More

JAM Stack with Phil Hawksworth

56:15 | Oct 24th, 2018

Engineers can build applications faster by using tools that abstract away infrastructure. Major cloud providers offer this tooling in the form of functions-as-a-service, as well as managed services such as Google BigQuery or Azure Container Instances...Show More

DevSecOps with Edward Thomson

55:29 | Oct 23rd, 2018

DevSecOps emphasizes moving security out of a siloed audit process and distributing security practices throughout the software supply chain. In the past, software development usually followed a waterfall development process. Each step in building sof...Show More

Google JavaScript with Malte Ubl

1:05:19 | Oct 22nd, 2018

Google Search is a highly interactive JavaScript application. As you enter a query, results are being automatically suggested to you before you even finish typing. When you press enter, some of your search results may be widgets that represent the we...Show More

AWS Containers with Deepak Singh

52:55 | Oct 19th, 2018

Deepak Singh is the director of compute services at AWS, where he works on cloud products relating to containers, Linux, and High Performance Computing. In today’s show, Deepak describes how the market for containers and serverless has evolved, and h...Show More

Open Source Product Strategy with Shaun Connolly

1:03:54 | Oct 18th, 2018

Linux has created much more value for Google than it has for Linus Torvalds. Ruby on Rails has created more value for Airbnb than it has for David Heinemeier Hansson. Successful open source projects create more value than their creators’ capture–and ...Show More

Cloud Search with Liam Cavanagh

51:37 | Oct 17th, 2018

Search is part of almost every application. Users search for movies to watch. Engineers search through terabytes of log messages to find exceptions. Drivers search through maps to find a destination. Search remains an unsolved problem, with lots of r...Show More

Open vSwitch: Virtual Networking with Ben Pfaff

43:20 | Oct 16th, 2018

Virtual machines are operating system instances that run alongside each other on the same physical host. The virtual machines running on a physical host are managed by a hypervisor running on the physical host. A cluster of two physical servers could...Show More

Data Warehouse with Christian Kleinerman

1:03:26 | Oct 15th, 2018

A data warehouse provides fast access to large data sets for analytics, data science, and dashboards. A data warehouse differs from a transactional database, because you often do not need to update specific records. Because of the read-only nature of...Show More

DevOps at Microsoft with Martin Woodward

1:04:56 | Oct 12th, 2018

The Windows operating system is one of the most widely used pieces of software in history. Windows was started before there was any alternative to a monolithic codebase, because Microsoft was building software before the Internet was widely used by c...Show More

Generative Models with Doug Eck

1:08:59 | Oct 11th, 2018

Google Brain is an engineering team focused on deep learning research and applications. One growing area of interest within Google Brain is that of generative models. A generative model uses neural networks and a large data set to create new data sim...Show More

Mapillary: Computer Vision Crowdsourcing with Peter Neubauer

1:07:53 | Oct 10th, 2018

Mapillary is a platform for gathering photos taken by smartphones and using that data to build a 3D model of the world. Mapillary’s model of the world includes labeled objects such as traffic signs, trees, humans, and buildings. This 3D model can be ...Show More

Digital Privacy with Aran Khanna

1:02:36 | Oct 9th, 2018

When Aran Khanna was a college student, he accepted an internship to work at Facebook. Even before his internship started, he started playing around with Facebook’s APIs and applications. Aran built a Chrome extension called Marauder’s Map, which use...Show More

Airbnb Engineering with Surabhi Gupta

51:31 | Oct 8th, 2018

Airbnb began in 2008 as a monolithic Rails application serving the simple purpose of listing homes for rental. Over time, the number of listings increased dramatically, as did the number of people who were renting. With that scale, the Rails app had ...Show More

Monolith Migration with Jan Schiffman and Sherman Wood

50:56 | Oct 6th, 2018

We previously released this episode with the wrong audio file and are re-releasing it on a weekend. TIBCO was started in the 90’s with a popular message bus product that was widely used by finance companies, logistics providers, and other systems wit...Show More

Scalyr: Column-Oriented Log Management with Steve Newman

59:28 | Oct 5th, 2018

Log messages are fast, high volume, unstructured data. Logs are often the source of metrics, alerts, and dashboards, so these critical systems are downstream from a log management system. A log management system needs to be highly available, so that ...Show More

Database Performance and Optimization with Andrew Davidson

1:06:36 | Oct 4th, 2018

When a database gets large, it can start to perform poorly. This can manifest in slow query speed. You can speed up a query by defining an index, which is a data structure that allows for faster access to the data that is being indexed. As a conseque...Show More

Cursor: Data Collaboration with Adam Weinstein

54:58 | Oct 3rd, 2018

Linkedin is an organization with thousands of employees. An enterprise of that size starts to develop problems with data collaboration. Data collaboration is the process of sharing and analyzing data with multiple users, such as data scientists, busi...Show More

Continuous Integration in Open Source with Oren Novotny

57:22 | Oct 1st, 2018

Open source software is key to our software infrastructure. Closed source enterprises rely on open source software, but the development processes for closed source and open source software are often different in their approach to continuous integrati...Show More

Prisma: GraphQL Infrastructure with Soren Bramer Schmidt

54:17 | Sep 28th, 2018

GraphQL allows developers to communicate with all of their different data backends through a consistent query interface. A GraphQL query can be translated into queries to MySQL, MongoDB, ElasticSearch, or whatever kind of API or backend is needed to ...Show More

Android Things with Wayne Piekarski

1:02:01 | Sep 27th, 2018

Internet of Things is a concept that describes lots of devices that you interact with regularly being connected to the Internet and networked together. Technologists have been dreaming of the world of IoT for many years, where our connected refrigera...Show More

Unity and WebAssembly with Brett Bibby

1:08:16 | Sep 25th, 2018

Unity is a game engine for building 2-D and 3-D experiences, augmented reality, movies, and other applications. Unity is cross-platform, so that applications can be written once and deployed to iOS, Android, web, and other surfaces. Unity has been ar...Show More

Front Engineering with Laurent Perrin

53:55 | Sep 24th, 2018

Front is a shared inbox application that has seen rapid adoption within companies. Front allows multiple members of a company to collaborate together on a conversation–whether that conversation is in email, Twitter, or Facebook Messenger. This is use...Show More

Checkr: Background Check Platform with Tomas Barreto

1:03:55 | Sep 21st, 2018

Background checks are a routine part of the hiring process. After a potential employee has made it through job interviews, a background check is administered to look through the applicant’s work history, criminal record, and other available data. Con...Show More

Android on Chrome with Shahid Hussain and Stefan Kuhne

54:35 | Sep 20th, 2018

Google has two consumer operating systems: Android and Chrome. The Android operating system has been widely deployed on mobile devices. Chrome is an operating system for laptops and tablets, originally based around the Chrome browser. For several yea...Show More

Kubernetes Distributions with Brian Gracely and Michael Hausenblas

1:03:32 | Sep 19th, 2018

Kubernetes is an open source container management system. Kubernetes is sometimes described as “the Linux of distributed systems” and this description makes sense: the large numbers of users and contributors in the Kubernetes community is comparable ...Show More

Continuous Delivery Pipelines with Abel Wang

49:38 | Sep 18th, 2018

Continuous integration and delivery allows teams to move faster by allowing developers to ship code independently of each other. A multi-stage CD pipeline might consist of development, staging, testing, and production. At each of these stages, a new ...Show More

DEV Community with Ben Halpern

1:03:22 | Sep 17th, 2018

The DEV Community is a platform where developers share ideas, programming advice, and tools. Ben Halpern started it after running an extremely successful Twitter account creating humorous tweets for developers. One way to describe DEV Community is as...Show More

Druid Analytical Database with Fangjin Yang

53:01 | Sep 14th, 2018

Modern applications produce large numbers of events. These events can be users clicking, IoT sensors accumulating data, or log messages. The cost of cloud storage and compute continues to drop, so engineers can afford to build applications around the...Show More

Orchestrating Kubernetes with Chris Gaun

59:15 | Sep 13th, 2018

A company runs a variety of distributed systems applications such as Hadoop for batch processing jobs, Spark for data science, and Kubernetes for container management. These distributed systems tools can run on-prem, in a cloud provider, or in a hybr...Show More

Netflix Observability with Kevin Lew

54:20 | Sep 12th, 2018

Netflix users stream terabytes of data from the cloud to their devices every day. During a high bandwidth, long-lived connection, a lot can go wrong. Networks can drop packets, machines can run out of memory, and the Netflix app on a user’s device ca...Show More

Real Estate Machine Learning with Or Hiltch

58:14 | Sep 11th, 2018

Stock traders have access to high volumes of information to help them make decisions on whether to buy an asset. A trader who is considering buying a share of Google stock can find charts, reports, and statistical tools to help with their decision. T...Show More

Kubernetes Continuous Deployment with Sheroy Marker

54:16 | Sep 10th, 2018

Engineering organizations can operate more efficiently by working with a continuous integration and continuous deployment workflow. Continuous integration is the process of automatically building and deploying code that gets pushed to a remote reposi...Show More

Go To Market with Mitch Ferguson

1:18:44 | Sep 7th, 2018

Engineers need to have an awareness of the business model that allows their company to succeed. When a software company is going to market, the engineers need to work closely with the sales and marketing team to formulate a strategy for building and ...Show More

Music Engineering with Dom Kane

1:07:23 | Sep 6th, 2018

For most of history, a typical musician would learn to play one specific instrument. As synthesizers became available to the public, it became commonplace for a musician to create their own instruments using hardware and software. By the early 2000s,...Show More

Faust: Streaming at Robinhood with Ask Solem

53:48 | Sep 5th, 2018

Robinhood is a platform for buying and selling stocks, cryptocurrencies, and other assets. Since its founding in 2013, Robinhood has grown to have more than 3 million user accounts, which is approximately the same as the popular online broker E-Trade...Show More

Monolith Migration with Jan Schiffman and Sherman Wood

50:55 | Sep 4th, 2018

TIBCO was started in the 90’s with a popular message bus product that was widely used by finance companies, logistics providers, and other systems with high throughput. As TIBCO grew in popularity, the company expanded into other areas through produc...Show More

RideOS: Fleet Management with Rohan Paranjpe

58:11 | Aug 31st, 2018

Self-driving transportation will be widely deployed at some point in the future. How far off is that future? There are widely varying estimations: maybe you will summon a self-driving Uber in a New York within 5 years, or maybe it will take 20 years ...Show More

Kubernetes Impact with Clayton Coleman

1:11:26 | Aug 30th, 2018

Kubernetes is in production clusters around the world with hundreds of thousands of containers. Kubernetes provides a distributed systems management environment for small startups and giant enterprises with applications ranging from microservices to ...Show More

DataOps with Christopher Bergh

1:04:39 | Aug 29th, 2018

Every company with a large set of customers has a large set of data–whether that company is 5 years old or 50 years old. That data is valuable whether you are an insurance company, a soft drink manufacturer, or a ridesharing company. All of these lar...Show More

Android Slices with Jason Monk

57:15 | Aug 28th, 2018

The main user interfaces today are the smartphone, the laptop, and the desktop computer. Some people today interact with voice interfaces, augmented reality, virtual reality, and automotive computer screens like the Tesla. In the future, these other ...Show More

Helm with Michelle Noorali

57:18 | Aug 27th, 2018

Back in 2014, platform-as-a-service was becoming an increasingly popular idea. The idea of PaaS was to sit on top of infrastructure-as-a-service providers like Azure, AWS, or Google Cloud, and simplify some of the complexity of these infrastructure p...Show More

Build Faster with Nader Dabit

1:07:06 | Aug 24th, 2018

Building software today is much faster than it was just a few years ago. The tools are higher level, and abstract away tasks that would have required months of development. Much of a developer’s time used to be spent optimizing databases, load balanc...Show More

StitchFix Engineering with Cathy Polinsky

57:17 | Aug 23rd, 2018

Stitch Fix is a company that recommends packages of clothing based on a set of preferences that the user defines and updates over time. Stitch Fix’s software platform includes the website, data engineering infrastructure, and warehouse software. Stit...Show More

OLIO: Food Sharing with Lloyd Watkin

46:52 | Aug 21st, 2018

Food gets thrown away from restaurants, homes, catering companies, and any other place with a kitchen. Most of this food gets thrown away when it is still edible, and could provide nutrition to someone who is hungry. Just like Airbnb makes use of exc...Show More

DoorDash Engineering with Raghav Ramesh

58:55 | Aug 16th, 2018

DoorDash is a last mile logistics company that connects customers with their favorite national and local businesses. When a customer orders from a restaurant, DoorDash needs to identify the ideal driver for picking up the order from the restaurant an...Show More

Casa: Crypto Wallet Security with Jameson Lopp

1:06:28 | Aug 15th, 2018

Cryptocurrency security is a concern to anyone who has a significant amount of money in the form of Bitcoin, Ethereum, or other crypto assets. Most Bitcoin is held in either a Bitcoin wallet or a Bitcoin bank. Your Bitcoin holdings are recorded on a ...Show More

Infrastructure Monitoring with Mark Carter

56:17 | Aug 14th, 2018

At Google, the job of a site reliability engineer involves building tools to automate infrastructure operations. If a server crashes, there is automation in place to create a new server. If a service starts to receive a high load of traffic, there is...Show More

GitOps: Kubernetes Continuous Delivery with Alexis Richardson

48:40 | Aug 13th, 2018

Continuous delivery is a way of releasing software without requiring software engineers to synchronize during a release.  Over the last decade, continuous delivery workflows have evolved as the tools have changed. Jenkins was one of the first continu...Show More

Klarna Engineering with Marcus Granström

51:44 | Aug 10th, 2018

Klarna is a payments company headquartered in Sweden. Since being established in 2005 it has grown to handling $21 billion in online sales in 2017. Roughly 40% of all e-commerce sales in Sweden go through Klarna. Klarna’s original differentiator was ...Show More

Stripe Engineering with Raylene Yung

48:23 | Aug 9th, 2018

Stripe is a payments API that allows merchants to transact online. Since the creation of the payments API, Stripe has expanded into adjacent services such as fraud detection, business management, and billing. These other verticals leverage the existi...Show More

Self-Driving Engineering with George Hotz

1:04:32 | Aug 8th, 2018

In the smartphone market there are two dominant operating systems: one closed source (iPhone) and one open source (Android). The market for self-driving cars could play out the same way, with a company like Tesla becoming the closed source iPhone of ...Show More

Future Architecture with Chad Fowler

1:08:31 | Aug 7th, 2018

Chad Fowler was the CTO of Wunderlist prior to its acquisition by Microsoft. Since the acquisition, Chad has become the general manager of developer advocacy at Microsoft. He also works as a venture capitalist at BlueYard Capital, an early stage inve...Show More

Splice: Music Collaboration with Matt Aimonetti

1:04:12 | Aug 6th, 2018

Music collaboration has historically been accomplished by musicians gathering in bands. A band is usually an in-person, physical manifestation: a drummer, a guitarist, a piano player. Or, on a large scale, a symphony of classical instruments led by a...Show More

GraalVM with Thomas Wuerthinger

56:09 | Aug 3rd, 2018

Java programs compile into Java bytecode. Java bytecode executes in the Java Virtual Machine, a runtime environment that compiles that bytecode further into machine code, and optimizes the runtime by identifying “hot” code paths and keeping those hot...Show More

Token Types with Felipe Pereira

56:02 | Aug 2nd, 2018

A token is a unit of virtual currency. Most tokens are built on a blockchain-based cryptocurrency platform, such as Ethereum. Building on top of a platform like Ethereum allows these tokens to form their own financial ecosystem while leveraging the s...Show More

Castor EDC with Derk Arts

55:38 | Aug 1st, 2018

Medical breakthroughs require medical research. Medical research requires patient testing and data collection. The most common form of capturing patient data is through surveys–and most of those surveys today are done on paper. Surveying patients to ...Show More

Jailbreaking Apple Watch with Max Bazaliy

48:29 | Jul 31st, 2018

Apple operating systems are closed source. This closed source nature gives Apple an extremely successful business model–and a very different software developer ecosystem than Linux-based systems. Since Linux is open source, the information on how to ...Show More

Edge Kubernetes with Venkat Yalla

57:43 | Jul 30th, 2018

“Edge computing” is a term used to define computation that takes place in an environment outside of a data center. Edge computing is a broad term. Your smartphone is an edge device. A self-driving car is an edge device. A security camera with a compu...Show More

React Native at Airbnb with Gabriel Peal

1:01:23 | Jul 27th, 2018

React Native allows developers to reuse frontend code between mobile platforms. A user interface component written in React Native can be used in both iOS and Android codebases. Since React Native allows for code reuse, this can save time for develop...Show More

Ghost: Open Source Publishing Platform with John O’Nolan

1:07:15 | Jul 26th, 2018

Blogging is more than 20 years old. Over that period of time, numerous publishing platforms have been created. Squarespace, Blogger, Medium, and Twitter are popular closed source platforms. WordPress has been the most popular open source blogging pla...Show More

Video Games and Funding Techniques with Howard Marks

1:08:15 | Jul 25th, 2018

Howard Marks ran two video game companies in the 90’s: Activision and Acclaim. While running these companies, he developed a love for entrepreneurship that he maintains today. Howard is the CEO of StartEngine, a company that functions as an accelerat...Show More

Video Machine Learning with Ben Dodson

53:03 | Jul 24th, 2018

Video streaming platforms like Netflix offer a convenient way to watch video content. We are now able to watch our favorite TV shows, movies, or content creators on a range of devices. However, buffering while watching videos can be a painful experie...Show More

Kubernetes in the Enterprise with Aparna Sinha

59:07 | Jul 23rd, 2018

Enterprises want to update their technology faster. One way an enterprise can accelerate the adoption of new tools is to move more aggressively towards the cloud. By giving internal developers access to the cloud, it becomes easier to provision new s...Show More

WebAssembly with Lin Clark

1:00:33 | Jul 20th, 2018

JavaScript has been the exclusive language of the web browser for the last 20 years. Whether you use Chrome, Firefox, Internet Explorer, or Safari, your browser interprets and executes code in a virtual machine–and that virtual machine only runs Java...Show More

Botchain with Rob May

53:24 | Jul 19th, 2018

“Bots” are becoming increasingly relevant to our everyday interactions with technology. A bot sometimes mediates the interactions of two people. Examples of bots include automated reply systems, intelligent chat bots, classification systems, and pred...Show More

Build a Bank: N26 with Pat Kua

1:00:00 | Jul 18th, 2018

Banking has been a part of the economy for 600 years. Banking has always been evolving. The most recent evolution: the financial industry has been going digital. Newer “fintech” companies have created innovative ways of doing everything related to mo...Show More

Counting People with Andrew Farah

50:53 | Jul 16th, 2018

If you operate a restaurant, you want to know how many people are inside your restaurant at any given time. You also want to be able to know your occupancy if you operate a movie theater, coffee shop, or apparel store. Knowing how many people are in ...Show More

Machine Learning Deployments with Diego Oppenheimer

1:00:33 | Jul 13th, 2018

Machine learning models allow our applications to perform highly accurate inferences. A model can be used to classify a picture as a cat, or to predict what movie I might want to watch. But before a machine learning model can be used to make these in...Show More

Ballerina Language with Tyler Jewell

54:55 | Jul 12th, 2018

Modern programming requires lots of integration between APIs. Some of these integrations are trivial–such as using Twilio or Stripe. But there are many more complex integrations. For example, when a large company acquires a smaller company, the acqui...Show More

Flutter in Practice with Randal Schwartz

1:02:04 | Jul 11th, 2018

Flutter allows developers to build cross-platform mobile apps. In our previous show about Flutter, Eric Seidel from Google described the goals of Flutter, why he founded the project, and how Flutter is built. In today’s show, Randal Schwartz talks ab...Show More

Build a Bank: Nubank with Edward Wible

59:49 | Jul 10th, 2018

Nubank was started in 2013 with a credit card that was controlled through a mobile app. At the time, it was the first service in Brazil that allowed customers to do banking without going to a physical bank branch. Since then, Nubank has expanded into...Show More

Flutter with Eric Seidel

55:29 | Jul 9th, 2018

Flutter is a project from Google that is rebuilding user interface engineering from the ground up. Today, most engineering teams have dedicated engineering resources for web, iOS, and Android. These different platforms have their own design constrain...Show More

Future Projection with Tim O’Reilly

1:06:46 | Jul 6th, 2018

Tim O’Reilly’s book What’s the Future? is an overview of business, technology, and society. As the founder of O’Reilly Media, Tim has been steeped in technology trends for the last 40 years. From his vantage point running conferences and publishing t...Show More

Machine Learning Stroke Identification with David Golan

57:05 | Jul 5th, 2018

When a patient comes into the hospital with stroke symptoms, the hospital will give that patient a CAT scan, a 3-dimensional imaging of the patient’s brain. The CAT scan needs to be examined by a radiologist, and the radiologist will decide whether t...Show More

Fintech Environment with Michael Walsh

57:01 | Jul 3rd, 2018

Computer systems consume memory, CPU, battery, data, and network bandwidth as inputs. These systems provide value for the end user by delivering information, virtual objects, and physical products as outputs. Another fundamental resource that is beco...Show More

Data Engineering Automation with Mike Kim

1:02:38 | Jun 29th, 2018

Every company has the idea of the “nightly report.” A business analyst comes into the office, sits down in front their inbox, and looks at yesterday’s data. Did sales go up? Did the marketing campaigns bring in the expected number of customers? Was t...Show More

Chrome and Chromium with David Bokan

56:10 | Jun 28th, 2018

Chromium is an open source browser that shares code with the Chrome browser from Google. A browser is a large piece of software, with engineering challenges around threading, rendering, resource management, and networking. To add to the complexity, C...Show More

Shopify Infrastructure with Niko Kurtti

53:44 | Jun 27th, 2018

Shopify runs more than 600,000 small business websites. When Shopify was figuring out how to scale, the engineering teams did not have a standard workflow for how to deploy and manage services. Some teams used AWS, some teams used Heroku, some teams ...Show More

Function Platforms with Chad Arimura and Matt Stephenson

52:58 | Jun 26th, 2018

“Serverless” is a word used to describe functions that get deployed and run without the developer having to manage the infrastructure explicitly. Instead of creating a server, installing the dependencies, and executing your code, the developer just p...Show More

Build a Bank: Monzo with Richard Dingwall

57:03 | Jun 25th, 2018

When you interact with your bank, it probably feels different than when you interact with a software technology company. That’s because the biggest banks in the world were started before software became such a universally important tool. Their core c...Show More

Browser Building with Osine Ikhianosime

29:14 | Jun 23rd, 2018

Crocodile Browser is a fast browser built by Osine and Anesi Ikhianosime, a pair of brothers from Nigeria. I interviewed them 3 years ago, and in this episode I caught up with Osine to learn what he and his brother have been working on since then. Os...Show More

Video Search with Rasty Turek

1:05:14 | Jun 22nd, 2018

Searching through all of the videos on the Internet is not a simple problem. In order to search through all the videos, you need to build a search index. In order to build a search index, you need to build a web crawler. Video files are large. To sto...Show More

Babel with Henry Zhu

1:06:26 | Jun 21st, 2018

Different browsers consume JavaScript in different ways. When a new version of JavaScript comes out, developers are eager to use the new functionality of that language version. But if you are writing frontend JavaScript code, that code needs to be in...Show More

Database Reliability Engineering with Laine Campbell

1:03:15 | Jun 20th, 2018

Over the last decade, cloud computing made it easier to programmatically define what infrastructure we have running, and perform operations across that infrastructure. This is called “infrastructure as code.” Whether you want to backup a database, de...Show More

Rust Networking with Carl Lerche

53:37 | Jun 19th, 2018

Rust is a systems programming language with a distinct set of features for safety and concurrency. In previous shows about Rust, we explored how Rust can prevent crashes and eliminate data races through its approach to type safety and memory manageme...Show More

Dremio Data Engineering with Tomer Shiran

1:02:00 | Jun 18th, 2018

Twenty years ago, all of the data in an organization could fit inside of relational databases. Imagine a company like Proctor and Gamble. P&G is a consumer packaged goods company with hundreds of business sectors–shaving products, toothpaste, shampoo...Show More

Digital Evolution with Joel Lehman, Dusan Misevic, and Jeff Clune

57:50 | Jun 15th, 2018

Evolutionary algorithms can generate surprising, effective solutions to our problems. Evolutionary algorithms are often let loose within a simulated environment. The algorithm is given a function to optimize for, and the engineers expect that algorit...Show More

Hacking Your Short-Term Rental with Jeremy Galloway

54:34 | Jun 14th, 2018

If you have ever stayed in a short-term rental (like an Airbnb, HomeAway, or CouchSurfing), you have probably used the wifi network at that rental property. Why wouldn’t you? It’s no different than hopping on an open wifi network at an airport, or a ...Show More

Postgres Sharding and Scalability with Marco Slot

1:01:20 | Jun 13th, 2018

Relational databases have been popular since the 1970s, but in the last 20 years the amount of data that applications need to collect and store has skyrocketed. The raw cost to store that data has decreased. There is a common phrase in software compa...Show More

Necto: Build an ISP with Adam Montgomery

1:05:17 | Jun 12th, 2018

In the tech industry, we have all grown to fear “lock-in.” Lock-in is a situation in which you have no choice but to pay a certain provider for some aspect of your computer services. Since computers are so fundamental to our lives, we sometimes have ...Show More

Investment Games with Brian Singerman

1:02:12 | Jun 8th, 2018

Investing is an infinite game. In a game, a player can formulate a strategy based on the available resources, the apparent variance of the environment, and the metagame of the other actors involved. For an investor, the game board includes companies,...Show More

Future of Computing with John Hennessy

1:01:44 | Jun 7th, 2018

Moore’s Law states that the number of transistors in a dense integrated circuit doubles about every two years. Moore’s Law is less like a “law” and more like an observation or a prediction. Moore’s Law is ending. We can no longer fit an increasing am...Show More

Container Storage with Jie Yu

59:24 | Jun 6th, 2018

A database stores data to an underlying section of storage. If you are an application developer, you might think of your persistent storage system as being the database itself–but at a lower level, that database is writing to block storage, file stor...Show More

Profilers with Julia Evans

51:20 | Jun 5th, 2018

When software is performing suboptimally, the programmer can use a variety of tools to diagnose problems and improve the quality of the code. A profiler is a tool for examining where a program is spending time. Every program consists of a set of diff...Show More

OpenAI: Compute and Safety with Dario Amodei

1:03:13 | Jun 4th, 2018

Applications of artificial intelligence are permeating our everyday lives. We notice it in small ways–improvements to speech recognition; better quality products being recommended to us; cheaper goods and services that have dropped in price because o...Show More

Scaling Ethereum with Raul Jordan and Preston Van Loon

53:54 | Jun 1st, 2018

Cryptocurrency infrastructure is a new form of software. Thousands of developers are submitting transactions to Bitcoin and Ethereum, and this transaction volume tests the scalability of current blockchain implementations. The bottlenecks in scalabil...Show More

Life Science R&D with Sherwin Yu

1:02:00 | May 31st, 2018

Ten years ago, a biology researcher was limited by the software tools available. Most of the electronic record keeping was done using Excel and other general purpose tools. Benchling is a suite of software tools that were designed to simplify the liv...Show More

Container Native Development with Ralph Squillace

55:01 | May 30th, 2018

Containers have improved deployments and resource utilization. Kubernetes created a platform to manage those containers and orchestrate them into distributed applications. In today’s episode, we explore tools that improve the workflow of the applicat...Show More

Pi Hole: Ad Blocker Hardware with Jacob Salmela

52:24 | May 29th, 2018

Ad blockers in the browser protect us from the most annoying marketing messages that the Internet tries to serve to us. But we still pay a price for these ads. We pay the bandwidth costs of requesting these pages. Our browsers are slowed down by thes...Show More

Autonomy with Frank Chen

59:19 | May 25th, 2018

Self-driving, electric cars will someday outnumber traditional automobiles on the road. As transportation becomes autonomous, it is hard to imagine an industry that will not be affected by the downstream effects of this change. These cars will likely...Show More

Uber’s Data Platform with Zhenxiao Luo

1:02:41 | May 24th, 2018

When a user takes a ride on Uber, the app on the user’s phone is communicating with Uber’s backend infrastructure, which is writing to a database that maintains the state of that user’s activity. This database is known as a transactional database or ...Show More

Software Law: GDPR, Patents, and Antitrust with Micah Kesselman

1:02:19 | May 23rd, 2018

The world of software moves faster than the laws that regulate it. When software companies do get regulated, that regulation is often enforced unevenly among different companies. Software continually presents the legal system with new requirements. C...Show More

Container Security with Maya Kaczorowski

47:21 | May 22nd, 2018

Deploying software to a container presents a different security model than deploying an application to a VM. There is a smaller attack surface per container, but the container is colocated on a node with other containers. Containers are meant to have...Show More

Voice with Rita Singh

1:02:59 | May 21st, 2018

A sample of the human voice is a rich piece of unstructured data. Voice recordings can be turned into visualizations called spectrograms. Machine learning models can be trained to identify features of these spectrograms. Using this kind of analytic s...Show More

Machine Learning with Data Skeptic and Second Spectrum at Telesign

1:10:00 | May 19th, 2018

Data Skeptic is a podcast about machine learning, data science, and how software affects our lives. The first guest on today’s episode is Kyle Polich, the host of Data Skeptic. Kyle is one of the best explainers of machine learning concepts I have me...Show More

Alexa Voice Design with Paul Cutsinger

55:03 | May 18th, 2018

Voice interfaces are a newer form of communicating with computers. Alexa is a voice interface platform from Amazon. Alexa powers the Amazon Echo, as well as Alexa-enabled cars, refrigerators, and dishwashers. Any developer can build a device with a v...Show More

Pulsar Messaging with Lewis Kaneshiro

1:00:53 | May 17th, 2018

Message broker systems decouple the consumers and producers of a message channel. In previous shows, we have explored ZeroMQ, PubNub, Apache Kafka, and NATS. In this episode, we talk about another message broker: Apache Pulsar. Pulsar is an open sour...Show More

Gloo: Function Gateway with Idit Levine

56:28 | May 16th, 2018

Gloo is a function gateway built on top of the popular open source project Envoy. The goal of Gloo is to decouple client-facing APIs from upstream APIs. Gloo is similar to an API gateway, which is a tool that software companies can use to collect all...Show More

Vitess: Scaling MySQL with Sugu Sougoumarane

59:01 | May 15th, 2018

YouTube runs a large MySQL database to hold the metadata about its videos. As YouTube scaled, the database was sharded, and applications within YouTube had to write queries that were aware of the sharding layout of that database. This is problematic,...Show More

Cloud Native Computing Foundation with Chris Aniszczyk and Dan Kohn

53:35 | May 14th, 2018

The Kubernetes ecosystem consists of enterprises, vendors, open source projects, and individual engineers. The Cloud Native Computing Foundation was created to balance the interests of all the different groups within the cloud native community. CNCF ...Show More

Cluster Schedulers with Ben Hindman

1:08:34 | May 11th, 2018

Mesos is a system for managing distributed systems. The goal of Mesos is to help engineers orchestrate resources among multi-node applications like Spark. Mesos can also manage lower level schedulers like Kubernetes. A common misconception is that Me...Show More

Deep Learning Topologies with Yinyin Liu

1:00:05 | May 10th, 2018

Algorithms for building neural networks have existed for decades. For a long time, neural networks were not widely used. Recent changes to the cost of compute and the size of our data have made neural networks extremely useful. Our smart phones gener...Show More

Data Engineering Podcast with Tobias Macey

58:16 | May 9th, 2018

Cloud computing lowered the cost and improved accessibility to tools for storing large volumes of data. In the early 2000s, Hadoop caused a revolution in large scale batch processing. Since then, companies have been building ways to store and access ...Show More

Stripe Atlas with Patrick McKenzie

56:47 | May 8th, 2018

Starting an Internet business is harder than it should be. You need to incorporate, create an operating agreement, set up a system to accept payments, and many other straightforward tasks. In the 1990s, this was how it felt to set up anything on the ...Show More

Affirm Engineering with Libor Michalek

59:52 | May 7th, 2018

When I buy a mattress online, I pay for it with my credit card. Behind the scenes, a complex series of transactions occur between a payment gateway, the credit card company, and a few banks. There are problems with this process–it is slow, complex, a...Show More

Superpedestrian Robotic Wheel / Infrastructure at HubSpot Meetup Talks

1:02:21 | May 5th, 2018

Superpedestrian is a robotic bicycle wheel that learns how you pedal and personalizes your bicycle ride. The engineering challenges of Superpedestrian are at the intersection of robotics, software, and real-time analytics. The first half of today’s s...Show More

Spark Geospatial Analytics with Ram Sriharsha

58:26 | May 4th, 2018

Phones are constantly tracking the location of a user in space. Devices like cars, smart watches, and drones are also picking up high volumes of location data. This location data is also called “geospatial data.” The amount of geospatial data is rapi...Show More

WannaCry’s Gray Hat with Reeves Wiedeman

43:23 | May 3rd, 2018

Last year, the WannaCry ransomware attack shut down hospitals, public transportation systems, and governments, demanding payment to unlock key computer systems. A programmer named Marcus Hutchins was able to stop WannaCry by registering a DNS entry b...Show More

Building Datadog with Alexis Le-Quoc

52:38 | May 2nd, 2018

Alexis Le-Quoc started Datadog in 2010, after living through the Internet boom and bust cycle of the late 90s and early 2000s. In 2010, cloud was just starting to become popular. There was a gap in the market for infrastructure monitoring tools, whic...Show More

Technology Utopia with Michael Solana

48:51 | May 1st, 2018

Technology is pushing us rapidly toward a future that is impossible to forecast. We try to imagine what that future might look like, and we can’t help having our predictions shaped by the media we have consumed. 1984, Terminator, Gattaca, Ex Machina,...Show More

Epicenter Cryptocurrencies with Brian Fabian Crain

1:00:23 | Apr 30th, 2018

Podcasting about cryptocurrencies is a strange occupation. You get emails all the time from companies doing a token sale that you would never want to be affiliated with. You get angry tweets from anonymous Twitter accounts that are on one side of the...Show More

Keybase Architecture / Clarifai Infrastructure Meetup Talks

1:12:50 | Apr 28th, 2018

Keybase is a platform for managing public key infrastructure. Keybase’s products simplify the complicated process of associating your identity with a public key. Keybase is the subject of the first half of today’s show. Michael Maxim, an engineer fro...Show More

Google Cluster Evolution with Brian Grant

51:21 | Apr 27th, 2018

Google’s central system for managing compute resources is called Borg. On Borg, millions of Linux containers process a wide variety of workloads. When a new application is spun up, Borg provides that application with the resources it needs. Workloads...Show More

TensorFlow Applications with Rajat Monga

56:40 | Apr 26th, 2018

Rajat Monga is a director of engineering at Google where he works on TensorFlow. TensorFlow is a framework for numerical computation developed at Google. The majority of TensorFlow users are building machine learning applications such as image recogn...Show More

Siftery Engineering with Ayan Barua

53:26 | Apr 25th, 2018

There are hundreds of different databases. There are tens of continuous delivery products. There is an ocean of cloud providers and CRM systems and monitoring platforms and sales prospecting tools. The range of available software products is so diver...Show More

NATS Messaging with Derek Collison

1:06:46 | Apr 24th, 2018

A message broker is an architectural component that sends messages between different nodes in a distributed system. Message brokers are useful because the sender of a message does not always know who might want to receive that message. Message broker...Show More

Stripe Observability Pipeline with Cory Watson

1:08:01 | Apr 23rd, 2018

Stripe processes payments for thousands of businesses. A single payment could involve 10 different networked services. If a payment fails, engineers need to be able to diagnose what happened. The root cause could lie in any of those services. Distrib...Show More

Bitcoin Debates with Roger Ver

1:02:01 | Apr 20th, 2018

Bitcoin and Bitcoin Cash are two cryptocurrencies with similar properties. But the supporters of each of these Bitcoin versions have strongly divergent opinions on the direction of the Bitcoin project. At the center of this debate is the subject of b...Show More

React Stack with G2i Team

1:02:14 | Apr 19th, 2018

Most new frontend webapps today use ReactJS. An increasing number of mobile apps are created using the cross-platform components of React Native. GraphQL, Facebook’s open source data-fetching middleware tool is being used by more and more companies, ...Show More

SafeGraph with Auren Hoffman

1:09:57 | Apr 18th, 2018

Machine learning tools are rapidly maturing. TensorFlow gave developers an open source version of Google’s internal machine learning framework. Cloud computing provides a cost effective, accessible way of training models. Edge computing allows for lo...Show More

Talking Bitcoin with Adam B. Levine

1:01:50 | Apr 17th, 2018

Let’s Talk Bitcoin is one of the most popular podcasts about cryptocurrencies. Adam B. Levine started it after three other podcasts he started did not get the traction he had hoped for. Adam parlayed the success of Let’s Talk Bitcoin into a network o...Show More

Monitoring Kubernetes with Ilan Rabinovitch

50:31 | Apr 16th, 2018

Monitoring a Kubernetes cluster allows operators to track the resource utilization of the containers within that cluster. In today’s episode, Ilan Rabinovitch joins the show to explore the different options for setting up monitoring, and some common ...Show More

Unchained with Laura Shin

1:01:14 | Apr 13th, 2018

Laura Shin is the host of Unchained, a podcast about cryptocurrencies and decentralized technology. For every episode, Laura does significant research and preparation, so the content turns out polished and high quality. Her enthusiasm for the subject...Show More

Mastodon: Federated Social Network with Eugen Rochko

1:00:46 | Apr 12th, 2018

Social networks can make you feel connected to a global society. But those social networks are controlled by a corporate entity. The profit motivations of the corporation are not directly aligned with the experience of the users. Mastodon is an open ...Show More

Go Systems with Erik St. Martin

57:53 | Apr 11th, 2018

Go is a language designed to improve systems programming. Go includes abstractions that simplify aspects of low level engineering that are historically difficult—concurrency, resource allocation, and dependency management. In that light, it makes sen...Show More

Database Chaos with Tammy Butow

59:54 | Apr 10th, 2018

Tammy Butow has worked at Digital Ocean and Dropbox, where she built out infrastructure and managed engineering teams. At both of these companies, the customer base was at a massive scale. At Dropbox, Tammy worked on the database that holds metadata ...Show More

Site Reliability Management with Mike Hiraga

47:17 | Apr 9th, 2018

Software engineers have interacted with operations teams since software was being written. In the 1990s, most operations teams worked with physical infrastructure. They made sure that servers were provisioned correctly and installed with the proper s...Show More

IPFS Design with David Dias

1:00:20 | Apr 6th, 2018

The Interplanetary File System (IPFS) is a decentralized global, peer-to-peer file system. IPFS combines ideas from BitTorrent, Git, and Bitcoin, creating a new way to store and access objects across the Internet. When you access an object on almost ...Show More

Ethereum Governance with Hudson Jameson

56:12 | Apr 5th, 2018

The Ethereum community started as a small group of dedicated engineers. It has ballooned to thousands of engineers, entrepreneurs and investors, all of whom have a stake in the direction of Ethereum. Ethereum is an open source project, and the direct...Show More

PubSub Infrastructure with Stephen Blum

1:00:36 | Apr 4th, 2018

The pubsub pattern allows a developer to create channels, which messages can be written to and read from. Pubsub messaging is useful for multicast messaging–when you want to publish messages from a producer, and have multiple consumers who are subscr...Show More

Gitcoin: Open Source Bounties with Kevin Owocki

57:59 | Apr 3rd, 2018

Most technology companies rely on open source software projects. But open source software projects are often maintained by a group of people that is not affiliated with any particular company. When an open source project develops too much technical d...Show More

Zcash Design with Sean Bowe

59:29 | Apr 2nd, 2018

Zcash is a payment and consensus system that allows users to transfer money to each other with strong guarantees of privacy. Zcash implements the same core features of Bitcoin, with the added functionality of shielded payments. Shielded payments are ...Show More

ShapeShift with Erik Voorhees

1:00:15 | Mar 30th, 2018

“The Federal Reserve System is fraudulent. Whatever its stated purpose, its effective purpose is to create a mechanism of deficit spending by politicians, through the insidious invisible taxation of monetary debasement (aka inflation).” These are the...Show More

Enterprise Smart Contracts with Marley Gray

53:28 | Mar 29th, 2018

We sign many different types of contracts throughout our lives. We sign a mortgage to get a loan for a house. When we go to the hospital, we sign a piece of paper that defines how our medical data can be shared between organizations. These pieces of ...Show More

Plasma: Smart Contract Scalability with Christian Reitwiessner

47:31 | Mar 28th, 2018

Ethereum is a system for running decentralized smart contracts. In the current implementation of Ethereum, every smart contract gets deployed to every full node. Whenever a user wants to call a smart contract, that smart contract gets executed on eac...Show More

Cryptocurrency Networking with Soumya Basu

54:59 | Mar 27th, 2018

Soumya Basu is a PhD student at Cornell, where he studies distributed systems problems associated with cryptocurrencies. Soumya is advised by Emin Gun Sirer, a Cornell professor who previously appeared on the show to discuss smart contract security. ...Show More

Consensus Systems with Ethan Buchman

1:03:03 | Mar 26th, 2018

Consensus protocols are used to allow computers to work together. A consensus protocol lets different servers agree on the state of a system. For decades, these protocols have been used to establish consensus among database nodes, application servers...Show More

DAO Reflections and with Christoph Jentzsch

57:52 | Mar 23rd, 2018

The DAO was a system of smart contracts on the Ethereum blockchain that investors put millions of dollars into. Back in May 2016, it was the largest crowdfunding event in history, and we discussed it in detail in a previous episode with Matt Leising....Show More

Streamr: Data Streaming Marketplace with Henri Pihkala

59:28 | Mar 22nd, 2018

Data streams about the weather can be used to predict how soybean futures are going to change in price. Satellite data streams can take pictures of the number of cars on the road, and judge how traffic patterns are changing. Search engines can aggreg...Show More Ethereum Mobile Browser with Jarrad Hope and Oskar Thoren

56:50 | Mar 21st, 2018

To use a web application, you probably open a web browser or a mobile app. To access an Ethereum application, many people use an Ethereum browser. In previous episodes, we explored Metamask and Mist, which are Ethereum browsers for the desktop. In to...Show More

The Business of Decentralization with Anthony Diiorio

35:46 | Mar 20th, 2018

Anthony Diiorio was involved with Ethereum since the earliest days. He was one of the first people to see the Ethereum ideas presented by Vitalik Buterin, and he invested deeply in Ethereum–both financially and by helping to establish the early Ether...Show More

ShapeShift Operations with Jon ShapeShift

54:42 | Mar 19th, 2018

A financial exchange is an operationally intensive business. You have customers making a high volume of transactions, your service has to be low latency and highly available, and you are dealing with a lot of money. A cryptocurrency exchange has all ...Show More

Crypto Pump and Dumps with Bruno Skvorc

59:14 | Mar 16th, 2018

Cryptocurrency speculation has pulled in a large population of people who do not know what they are investing in. If you hear about an investment of $1000 turning into $1M, it’s tempting to get sucked in yourself. For most of these everyday people, t...Show More

Crypto Bloomberg with Valentin Mihov

1:00:59 | Mar 15th, 2018

In the finance industry, many people have a computer on their desk called a Bloomberg terminal. A Bloomberg terminal contains news, stock prices, communication tools, and other features that make it worth a high subscription price. And people in fina...Show More

Web3 with Fabian Vogelsteller

51:53 | Mar 14th, 2018

Most applications today run on a cloud provider like AWS. They are built with a framework like Ruby on Rails. They use a set of APIs like Stripe and Twilio for middleware services. This is the era of “web 2.0.” With decentralized systems, we are star...Show More

Metamask with Dan Finlay

49:09 | Mar 13th, 2018

Decentralized applications can be built on the Ethereum blockchain. Just as the Bitcoin blockchain is a distributed, append-only ledger of financial transaction history, Ethereum is a distributed, append-only ledger of computational transaction histo...Show More

Monopolies and Proof of Stake with Karl Floersh

59:11 | Mar 12th, 2018

Decentralized applications might someday offer alternatives to modern monopolies. Uber, Airbnb, Facebook, Amazon—all of these services could be recreated on a decentralized stack of technologies like Ethereum, IPFS, and Golem. Fully decentralized ser...Show More

Proof of Stake with Subhan Nadeem

1:03:13 | Mar 9th, 2018

For a decade, Bitcoin’s proof-of-work system has run without disruption. In a proof-of-work scheme, Bitcoin miners compete to solve a cryptographic puzzle associated with a block of transactions. Every ten minutes, all the Bitcoin miner nodes race to...Show More

How Aragon Manages DAOs with Luis Cuende

53:16 | Mar 8th, 2018

Humans organize into groups. There are lots of group types: religions, corporations, national governments, state governments, citizenries, clubs, musical bands. Every group has governance. Governance defines the rules, and the ways that rules change....Show More

Smart Contracts with Raine Revere

52:10 | Mar 7th, 2018

Smart contracts are programs that run on the Ethereum blockchain. A smart contract developer pays Ether to deploy the contract. When a contract is deployed, every full node on the Ethereum blockchain has a copy of the contract code in that node’s add...Show More

Bitcoin’s Future with Joseph Bonneau

58:26 | Mar 6th, 2018

Joseph Bonneau is co-author of Bitcoin and Cryptocurrency Technologies, a popular textbook. At NYU, he works as an assistant professor exploring cryptography and security. His YouTube lessons teaching Bitcoin have hundreds of thousands of views. His ...Show More

Smart Agriculture with Mike Prorock

53:37 | Mar 5th, 2018

Farms have lots of data. A corn farmer needs to monitor the chemical composition of soil. A soybean farmer needs to track crop yield. A chicken farmer needs to count the number of eggs produced. If this data is captured, it can be acted upon—for exam...Show More

Dogecoin with Jackson Palmer

55:42 | Mar 2nd, 2018

Dogecoin was started in 2013 as a joke. Jackson Palmer forked Bitcoin and created his cryptocurrency as a play off the “doge” meme. The currency became popular as a means of reddit users “tipping” each other. If I made a comment on reddit that you li...Show More

Blockchain Scalability with Peter Ullrich

1:03:39 | Mar 1st, 2018

There are two factors that limit the rate at which transactions are accepted into the Bitcoin blockchain: block time and block size. Block time defines how often a new block is appended onto the blockchain. Block size defines how many transactions fi...Show More

Bitcoin Transactions with Daniel Van Flymen

52:06 | Feb 28th, 2018

Bitcoin is an immutable, append-only blockchain ledger that reaches consensus through proof-of-work. The contents of the ledger are financial transactions–people sending and receiving Bitcoin currency to each other. Since Bitcoin, there have been oth...Show More

Scale Self-Driving with Alexandr Wang

49:52 | Feb 27th, 2018

The easiest way to train a computer to recognize a picture of cat is to show the computer a million labeled images of cats. The easiest way to train a computer to recognize a stop sign is to show the computer a million labeled stop signs. Supervised ...Show More

Spark and Streaming with Matei Zaharia

1:00:04 | Feb 26th, 2018

Apache Spark is a system for processing large data sets in parallel. The core abstraction of Spark is the resilient distributed dataset (RDD), a working set of data that sits in memory for fast, iterative processing. Matei Zaharia created Spark with ...Show More

Cloud and Edge with Steve Herrod

1:03:44 | Feb 23rd, 2018

Steve Herrod led engineering at VMWare as the company scaled from 30 engineers to 3,000 engineers. After 11 years, he left to become a managing director for General Catalyst, a venture capital firm. Since he has both operating experience and a wide v...Show More

Serverless Systems with Eduardo Laureano

1:01:30 | Feb 22nd, 2018

On Software Engineering Daily, we have been covering the “serverless” movement in detail. For people who don’t use serverless functions, it seems like a niche. Serverless functions are stateless, auto-scaling, event driven blobs of code. You might sa...Show More

Cloud Foundry Overview with Mike Dalessio

1:02:40 | Feb 21st, 2018

Earlier this year we did several shows about Cloud Foundry, followed by several shows about Kubernetes. Both of these projects allow you to build scalable, multi-node applications–but they serve different types of users. Cloud Foundry encompasses a l...Show More

Kafka Design Patterns with Gwen Shapira

1:02:13 | Feb 20th, 2018

Kafka is at the center of modern streaming systems. Kafka serves as a database, a pubsub system, a buffer, and a data recovery tool. It’s an extremely flexible tool, and that flexibility has led to its use as a platform for a wide variety of data int...Show More

Streaming Architecture with Ted Dunning

1:00:53 | Feb 19th, 2018

Streaming architecture defines how large volumes of data make their way through an organization. Data is created at a user’s smartphone, or on a sensor inside of a conveyor belt at a factory. That data is sent to a set of backend services that aggreg...Show More

Streaming Analytics with Scott Kidder

56:46 | Feb 16th, 2018

When you go to a website where a video is playing, and your video lags, how does the website know that you are having a bad experience? Problems with video are often not complete failures–maybe part of the video loads, and plays just fine, and then t...Show More

Streaming Architecture with Tugdual Grall

57:53 | Feb 15th, 2018

At a big enough scale, every software product produces lots of data. Whether you are building an advertising technology company, a social network, or a system for IoT devices, you have thousands of events coming in at a fast pace that you want to agg...Show More

Machine Learning Deployments with Kinnary Jangla

47:12 | Feb 14th, 2018

Pinterest is a visual feed of ideas, products, clothing, and recipes. Millions of users browse Pinterest to find images and text that are tailored to their interests. Like most companies, Pinterest started with a large monolithic application that ser...Show More

Box Kubernetes Migration with Sam Ghods

56:17 | Feb 13th, 2018

Over 12 years of engineering, Box has developed a complex architecture of services. Whenever a user uploads a file to Box, that upload might cause 5 or 6 different services to react to the event. Each of these services is managed by a set of servers,...Show More

Scaling Box with Jeff Quiesser

48:11 | Feb 12th, 2018

When Box started in 2006, the small engineering team had a lot to learn. Box was one of the earliest cloud storage companies, with a product that allowed companies to securely upload files to remote storage. This was two years before Amazon Web Servi...Show More

Google BeyondCorp with Max Saltonstall

1:01:44 | Feb 9th, 2018

Employees often find themselves needing to do work outside of the office. Depending on the sensitivity of your task, accessing internal systems from a remote location may or may not be OK. If you are using a corporate application that shows the menu ...Show More

Load Testing Mobile Applications with Paulo Costa and Rodrigo Coutinho

56:54 | Feb 8th, 2018

Applications need to be ready to scale in response to high-load events. With mobile applications, this can be even more important. People rely on mobile applications such as banking, ride sharing, and GPS. During Black Friday, a popular ecommerce app...Show More

Tether, Ripple, and Blockchain Reporting with Matt Leising

1:19:40 | Feb 7th, 2018

Your friends from college are asking you how to buy Bitcoin. Your mom is emailing you articles about the benefits of decentralized peer-to-peer networks. Your shoe shiner is telling you to buy XRP. It is 2018, and cryptocurrencies have become a daily...Show More

Serverless at the Edge with Kenton Varda

59:48 | Feb 6th, 2018

Over the last decade, computation and storage has moved from on-premise hardware into the cloud data center. Instead of having large servers “on premise,” companies started to outsource their server workloads to cloud service providers. At the same t...Show More

Linkedin Resilience with Bhaskaran Devaraj and Xiao Li

50:16 | Feb 5th, 2018

How do you build resilient, failure tested systems? Redundancy, backups, and testing are all important. But there is also an increasing trend towards chaos engineering–the technique of inducing controlled failures in order to prove that a system is f...Show More

Chaos Engineering with Kolton Andrus

59:31 | Feb 2nd, 2018

The number of ways that applications can fail are numerous. Disks fail all the time. Servers overheat. Network connections get flaky. You assume that you are prepared for such a scenario, because you have replicated your servers. You have the databas...Show More

How to Change an Enterprise’s Software and Culture with Zhamak Dehghani

57:46 | Feb 1st, 2018

On this show, we spend a lot of time talking about CI/CD, data engineering, and microservices. These technologies have only been widely talked about for the last 5-10 years. That means that they are easy to adopt for startups that get founded in the ...Show More

Developer Stereotypes with Sue Loh

50:35 | Jan 31st, 2018

Sue Loh is a software engineer and author of a book with the goal of breaking developer stereotypes. Stereotyping among developers leads to bad outcomes. When incorrect assumptions are made about certain populations, those populations feel marginaliz...Show More

Design Principles From Functional Programming with Runar Bjarnason

41:26 | Jan 30th, 2018

Functional programming can improve the overall design of an application architecture. Runar Bjarnason has been exploring how writing in a functional style increases modularity and compositionality of software for many years. He is co-author of Functi...Show More

Deep Learning Hardware with Xin Wang

57:44 | Jan 29th, 2018

Training a deep learning model involves operations over tensors. A tensor is a multi-dimensional array of numbers. For several years, GPUs were used for these linear algebra calculations. That’s because graphics chips are built to efficiently process...Show More

Changelog Podcasting at KubeCon with Adam Stacoviak

35:56 | Jan 27th, 2018

At KubeCon, I had the chance to catch up with Adam Stacoviak of the Changelog, a podcast that was an inspiration for starting Software Engineering Daily. Changelog has long been one of my favorite podcasts about engineering, thanks in part to Adam’s ...Show More

Edge Deep Learning with Aran Khanna

57:36 | Jan 26th, 2018

A modern farm has hundreds of sensors to monitor the soil health, and robotic machinery to reap the vegetables. A modern shipping yard has hundreds of computers working together to orchestrate and analyze the freight that is coming in from overseas. ...Show More

Serverless Containers with Sean McKenna

55:55 | Jan 25th, 2018

After two weeks of episodes about Kubernetes, our in-depth coverage of container orchestration is drawing to a close. We have a few more shows on the topic before we move on to covering other aspects of software. If you have feedback on this thematic...Show More

Web Security at Cloudflare, Pinterest, and Segment

1:31:57 | Jan 24th, 2018

Last month, Software Engineering Daily had our 4th Meetup at Cloudflare in San Francisco. For this Meetup, the format was short interviews with security specialists from Pinterest, Cloudflare, and Segment. Each of these companies has unique security ...Show More

SpeechBoard with Craig Cannon and Ramon Recuero Moreno

1:02:52 | Jan 23rd, 2018

Creating a podcast is still too difficult. One of the main barriers to entry is the editing process. After recording a podcast, the podcast producer needs to line up soundwaves in a digital audio workstation and clip the raw audio files to remove sec...Show More

Container Instances with Gabe Monroy

54:24 | Jan 22nd, 2018

In 2011, platform-as-a-service was in its early days. It was around that time that Gabe Monroy started a container platform called Deis, with the goal of making an open source platform-as-a-service that anyone could deploy to whatever infrastructure ...Show More

Service Mesh Design with Oliver Gould

59:38 | Jan 19th, 2018

Oliver Gould worked at Twitter from 2010 to 2014. Twitter’s popularity was taking off, and the engineering team was learning how to scale the product. During that time, Twitter adopted Apache Mesos, and began breaking up its monolithic architecture i...Show More

Kubernetes Storage with Bassam Tabbara

1:00:39 | Jan 18th, 2018

Modern applications store most of their data on hosted storage solutions. We use hosted block storage to back databases, hosted object storage for objects such as videos, and hosted file storage for file systems. Using a cloud provider for these stor...Show More

Kubernetes State Management with Niraj Tolia

55:26 | Jan 17th, 2018

A common problem in a distributed system: how do you take a snapshot of the global state of that system? Snapshot is difficult because you need to tell every node in the system to simultaneously record its state. There are several reasons to take a s...Show More

Kubernetes Operations with Brian Redbeard

52:09 | Jan 16th, 2018

In the last four years, CoreOS has been at the center of enterprise adoption of containers. During that time, Brian Harrington (or “Redbeard”) has seen a lot of deployments. In this episode, Brian discusses the patterns he has seen among successful K...Show More

FluentD with Eduardo Silva

53:03 | Jan 15th, 2018

A backend application can have hundreds of services written in different programming frameworks and languages. Across these different languages, log messages are produced in different formats. Some logging is produced in XML, some is produced in JSON...Show More

The Gravity of Kubernetes

1:02:41 | Jan 13th, 2018

Kubernetes has become the standard way of deploying new distributed applications. Most new internet businesses started in the foreseeable future will leverage Kubernetes (whether they realize it or not). Many old applications are migrating to Kuberne...Show More

Kubernetes Vision with Brendan Burns

57:26 | Jan 12th, 2018

Kubernetes has become the standard system for deploying and managing clusters of containers. But the vision of the project goes beyond managing containers. The long-term goal is to democratize the ability to build distributed systems. Brendan Burns i...Show More

High Volume Distributed Tracing with Ben Sigelman

57:46 | Jan 11th, 2018

You are requesting a car from a ridesharing service such as Lyft. Your request hits the Lyft servers and begins trying to get you a car. It takes your geolocation, and passes the geolocation to a service that finds cars that are nearby, and puts all ...Show More

Kubernetes on AWS with Arun Gupta

52:24 | Jan 10th, 2018

Since Kubernetes came out, engineers have been deploying clusters to Amazon. In the early years of Kubernetes, deploying to AWS meant that you had to manage the availability of the cluster yourself. You needed to configure etcd and your master nodes ...Show More

Istio Motivations with Louis Ryan

57:05 | Jan 9th, 2018

A single user request hits Google’s servers. A user is looking for search results. In order to deliver those search results, that request will have to hit several different internal services on the way to getting a response. These different services ...Show More

Kubernetes Usability with Joe Beda

1:08:24 | Jan 8th, 2018

Docker was released in 2013, and popularized the use of containers. A container is an abstraction for isolating a well-defined portion of an operating system. Developers quickly latched onto containers as a way to cut down on the cost of virtual mach...Show More

Cloud R&D with Onsi Fakhouri

58:03 | Jan 5th, 2018

In the first 10 years of cloud computing, a set of technologies emerge that every software enterprise needs; continuous delivery, version control, logging, monitoring, routing, data warehousing. These tools were built into the Cloud Foundry project, ...Show More

Spring Data with John Blum

1:03:23 | Jan 4th, 2018

In the 1980s and the 1990s, most applications used only a relational database for their data management. In the early 2000s, software projects started to use an ever increasing number of data sources. MongoDB popularized the document database, which ...Show More

Cloud Foundry with Rupa Nandi

57:08 | Jan 3rd, 2018

Cloud Foundry is an open-source platform as a