Issue #491

23 February 2024


Issue #491
pointer.io


Friday 23rd February’s issue is presented by WorkOS

The Modern Identity Platform For B2B SaaS


WorkOS provides easy-to-use APIs for auth, user identity, and enterprise features like SSO and SCIM provisioning.


It's a drop-in replacement for Auth0 and supports up to 1 million monthly active users for free.


It's perfect for B2B SaaS companies frustrated with high costs, opaque pricing, and lack of enterprise capabilities supported by legacy auth vendors.

Listen Or Speak

— Mike Fisher


tl;dr: Mike, former CTO at Etsy, discusses how he navigates leadership styles - the under-importance of listening, the over-emphasis on speaking, and examples of how effective leaders leverage both. “While I still prefer a leadership style of listening before speaking, other than in emergency situations, the convergence of speaking and listening are complementary forces in leadership. The dynamic balance between the two crafts a leader who not only inspires but also empowers. Such leaders create environments where dialogue thrives, ideas flourish, and consensus is reached without compromising the vision or the drive needed for action.”


Leadership Management

Strength Dictates Weakness

— Andrew Bosworth


tl;dr: Andrew, the CTO at Meta, discusses how “your greatest strengths almost certainly dictate your greatest weaknesses... I have always considered communication a strength of mine. I enjoy speaking and writing, and do so often. I am forceful in championing my point of view. It took years to realize that I was “communicating” so much that I wasn’t listening. I was either drowning out my peers or waiting for my turn to speak.” Andrew discusses how this was a pivotal moment of growth for him. 

CareerAdvice

A Guide To Organization Modeling In Authentication


tl;dr: Organization modeling is a crucial part of building authentication and authorization into applications. However, once SSO and various user-organization relationships are thrown into the mix, the logic can become complex to manage. For developers building this in-house, there are important nuances and implementation details to consider.


Promoted by WorkOS

Management Guide

Scaling ChatGPT: Five Real-World Engineering Challenges

— Gergely Orosz, Evan Morikawa


tl;dr: An interview with Evan Morikawa, who led the OpenAI Applied Engineering team as ChatGPT launched and scaled. Evan reveals the five engineering challenges along with lessons learned. Challenges are: (1) KV Cache & GPU RAM. (2) Optimizing batch size. (3) Finding the right metrics to measure. (4) Finding GPUs wherever they are. (5) Inability to autoscale.  


OpenAI Scale

“If you’re going to do anything new or innovative, you have to be willing to be misunderstood.”


— Jeff Bezos

How Uber Serves Over 40 Million Reads Per Second From Online Storage Using An Integrated Cache


tl;dr: “Docstore is Uber’s in-house, distributed database built on top of MySQL. Storing tens of PBs of data and serving tens of millions of requests/second, it is one of the largest database engines at Uber used by microservices from all business verticals. Docstore users and use cases are growing, and so are the request volume and data footprint. This post discusses the challenges serving applications that require low-latency read access and high scalability.


Database Cache

The Self-Rendering Eval Shirt

— Eric Simons


tl;dr: The free t-shirts companies give away to developers are everywhere and, with a few exceptions, most are pretty boring: usually just a logo on a t-shirt. In this post, see how StackBlitz’s co-founder broke this mold with a t-shirt design that incorporated the StackBlitz logo constructed with *actually valid* JavaScript code that is the source code of the image itself.


Promoted by StackBlitz

JavaScript Entertaining

Let's Build The GPT Tokenizer

— Andrej Karpathy


tl;dr: “In this lecture we build from scratch the Tokenizer used in the GPT series from OpenAI. In the process, we will see that a lot of weird behaviors and problems of LLMs actually trace back to tokenization. We'll go through a number of these issues, discuss why tokenization is at fault, and why someone out there ideally finds a way to delete this stage entirely.”


Video GPT

The Billion Row Challenge (1BRC) - Step-By-Step From 71s To 1.7s

— Marko Topolnik


tl;dr: “The main thing I'd like to show you in this post is that a good part of that amazing speed comes from easy-to-grasp, reusable tricks that you could apply in your code as well. Towards the end, I'll also show you some of the magical parts that take it beyond that level.”


Database Optimization

Planner Programming Blows My Mind

— Hillel Wayne


tl;dr: “Picat is a research language intended to combine logic programming, imperative programming, and constraint solving. I originally learned it to help with vacation scheduling but soon discovered its planner module, which is one of the most fascinating programming models I’ve ever seen.” 


LanguageDesign

Notable Links


Dax: Cross-platform shell tools for Deno and Node.js


FaceFusion: Next gen face swapper and enhancer.


Peggy: Parser generator for JavaScript.


ReadySet: Transparent database cache for Postgres & MySQL.


Ruff: Fast Python linter and code formatter.


Click the below and shoot me an email!


1 = Didn't enjoy it all // 5 = Really enjoyed it


12345