#45 Michal Klos, Localytics and the World of Big Data

Michal Klos of Localytics tells me about their big data stack and where he thinks the industry is going.

Who he is, what he does; overview of the world of big data, history, batch processing, stream processing and micro batching; databases, Apache Spark, separating storage and compute; where he thinks the industry is going in the next five years, more about Spark, data lakes, query federation, Presto; how to get started with a big data project, picking technologies, doing a test; most big data projects fail, you should start small, get cross team involvement; how to scale to petabytes, start small with short expected lifespan; technologies Localytics uses, blog, they are hiring.


Book Recommendations
Hadoop Application Architectures

I Heart Logs: Event Data, Stream Processing, and Data Integration

Systems Performance: Enterprise and the Cloud

Small Is Beautiful: Economics as if People Mattered

Brilliant!: Shuji Nakamura And the Revolution in Lighting Technology

Barbarians at the Gate: The Fall of RJR Nabisco


Download mp3 of podcast

#43 Amir Rubin, Augmented Reality and Paracosm

Amir Rubin, CEO of Paracosm tells me about his company, the state of augmented reality, mixed reality and where his company fits in.

Who he is, what he does, what Paracosm does; human level of understanding; what is augmented reality, virtual reality and mixed reality, devices, phones, tablets, headsets; virtual reality is finally here?; common uses of Paracosm's tool, engineering tasks, construction projects, how to scan, depth sensors, dealing with errors; what happens after the data is uploaded; example of game playing on 3D environment; availability of devices; future of augmented reality, where Paracosm is going.

Download mp3 of podcast

#38 Mark Eisenberg, Private Cloud

Mark Eisenberg of Microsoft talks to me about the private cloud and why it has failed.

Definition of private cloud, virtualized data centers, getting value from the cloud; enterprise scale, web scale and hyper scale; differences between private and public cloud, daytime and nighttime workloads; cultural change is needed when adopting cloud; same software problem, different decade; companies expected cost reduction, but didn't get it; vertical scale doesn't work anymore, start small in cloud and grow; we got it wrong so often why would you expect anything different now; current state of private cloud; private cloud is failing; bringing in the skills to deploy private cloud, need exec buy-in; how to get buy-in; agility, complexity and cost example of success at Lowe's; wrap up.

Book Recommendation
Continuous Delivery

Building Microservices

The Art Of War

The Prince

The 48 Laws of Power

The Fountainhead

The Black Swan

Thinking, Fast and Slow

#34 Trevor Stricker, Indie Games

Trevor Stricker of Disco Pixel tells me all about indie game development.

Who he is and what he does; what is an indie game developer; skills needed to be an indie dev; protecting your work; platforms to develop on, naming your child Unity, learning about Unity, technical limitations; importance of partnerships as a game developer, corporate and developer partnerships; learning non games skills to scale your game; making money; book recommendations, Creativity, Inc.

Book Recommendations
Creativity, Inc.: Overcoming the Unseen Forces That Stand in the Way of True Inspiration

Good to Great: Why Some Companies Make the Leap...And Others Don't

The Mythical Man-Month: Essays on Software Engineering, Anniversary Edition (2nd Edition)

#33 Justin Mills, Yesware

Justin Mills, software engineer at Yesware tells me about their flat organizational structure and development practices.

Little about Justin and Yesware; team structure, no test team, no defined team leads; no cohesive architecture; shared infrastructure, hierarchy might be needed; getting approval to reduce technical debt; assigning teams to tasks, trying open allocation, ending open allocation; no titles in engineering but other departments have titles; no one in a position to make a tough decision; struggling with agile, speed of development is the goal.
**extended interview** SDLC, frequent releases probably break often,
Justin's hopes for the company's future.

Extended Interview

#32 Eliot Knudsen, Tamr and a Brave New World of Data

Eliot Knudsen, field engineer at Tamr talks to me about their machine learning tool and a new way of examining data.

Who he is and what he does; what is Tamr; working with data sources, the traditional way, the Tamr way, machine learning combined with human guidance;data quality and foreign languages; Thompson Reuters example, curating data, increasing speed; deploying Tamr; how Tamr works, db, java, web client; competitors; future work

#31 Jason MacInnes, Draft Kings

Jason MacInnes, CTO of Draft Kings tells me about their architecture and scaling demands.

A little about Jason; what Draft Kings is, why it's not gambling, how Draft Kings started; controlling growth, SDLC, Agile growing pains, aligning skills; software stack (MySql, RabbitMq, MassTransit), choice of ASP.NET; scaling the system; transitioning to micro-services, dev ops; service level agreements, dealing with unpredictable events; where the statistics and data come from, customer privacy, future work.

#30 Open Data Science Conference

Boston was host to the first ever Open Data Science Conference over the weekend of May 30th and 31st 2015. I spent the days wandering around talking to people with interesting stories.
I hope you enjoy this episode, it was fun making it.

My next podcast will be back to the normal interview format.

Music Credits
Opening music – The Return, niese23

Closing and other – Bit Rio by Podington Bear

#29 Lucybot, The Importance of Developer Experience

Andrew and Bobby Brennan, and I discuss Lucybot and why good API design and documentation lead to good developer experience.

Who they are; what Lucybot is, more than simple documentation; API economy, easier to work with is more important; easier to use API wins with developers; good vs bad API, good documentation, sandbox, example code; what Lucybot does, auto doc generation, auto code generation, machine readable API description, swagger; client libraries, auto generation; APIs for now developers, API recipes; other tools, swagger and alpaca; future work, repository for APIs, on premises deployment.

Book recommendations
Zen and the Art of Motorcycle Maintenance: An Inquiry Into Values

Atlas Shrugged

Breakfast of Champions

The Power of Kindness: The Unexpected Benefits of Leading a Compassionate Life

The Challenger Sale: Taking Control of the Customer Conversation

Zero to One: Notes on Startups, or How to Build the Future

#28 Eric Bloom, Getting Promoted and Managing in IT

Eric Bloom of Manger Mechanics and I discussing how to get promoted in IT and what to expect as a manager.

Who he is, new book, a productivity cocktail; getting promoted, what got you here won't get you there, staying or going, accidental managers, management is a skill; what if you don't want to manage; advice on getting promoted, get management experience outside the office, nepotism in companies; what changes when promoted, Manager Mechanics; leading without authority, difficult team members, people are for themselves not against you; common problems new managers face; learning to delegate; politics; professional friends come and go enemies accumulate; dealing with superiors, your manager and your manger's manger; you always have a boss; mangers live in fish bowls

Book Recommendations
Manager Mechanics: Tips and Advice for First-Time Managers

Your IT Career: Get Noticed, Get Promoted, and Build Your Professional Brand

52 Great Management Tips

Leading Apple With Steve Jobs: Management Lessons From a Controversial Genius

Emotional Intelligence: Why It Can Matter More Than IQ

Drive: The Surprising Truth About What Motivates Us