Weekly Listen #4

Posted on by Brendan

I stumbled on Kevin Rose’s podcast and decided to watch this one first. I was excited to find this because I watched his first interviews about 12 years ago with tech entrepreneurs and got a lot out of them. I think he called the show The Foundation back then.

One piece they talk about is encouraging failure and learning from failure for kids which I believe is important too. I’ve been enjoying watching my oldest who is 3 during soccer on Saturday mornings. He’s young so he’s failing a lot whether he picks up the soccer ball instead of kicking it or doesn’t understand the drill. Rather than correct him, I just watch him. He’s having fun anyway so that’s another reason I sit back. He doesn’t need my help.

I was thinking the other day at some point that his consciousness will develop and we’ll see how he reacts to knowing about these small failures.

Learnings & Thoughts on RAG

Posted on by Brendan

I enjoyed this essay on X about RAG and learned a lot. 

Part of LLMs advancing is a technology called RAG (retrieval augmentation generation). RAG is an evolving technology in the world of information retrieval for LLMs but it has problems. 

  1. For large models, freshness of source data for time sensitive queries is a limiter right now. A LLM needs to update it’s data source and put it back through the AI model and know to site the new source when a user writes a prompt or query. 
  2. RAGs has a similar problem for smaller models too. Amongst a corpus of internal documents with perhaps conflicting information because there are drafts how does the RAG know which once to use? 

I think one important quote from Aaron that ties to a post from Google is this: “The AI’s answer is only as good as the underlying information that you serve it in the prompt.” Google’s Liz Reid wrote: “With our custom Gemini model’s multi-step reasoning capabilities, AI Overviews will help with increasingly complex questions. Rather than breaking your question into multiple searches, you can ask your most complex questions, with all the nuances and caveats you have in mind, all in one go.” 

This is something we started talking about 12+ months ago at this point where the better the prompt the better the answer. It’s clear search engines and LLMs are trying to nudge humans to change search behavior in this way to improve answers and reduce hallucinations. 

The question on my mind is, will consumers change their search behavior to more complex searches or will tech companies need to find other ways to improve source identification during RAG to improve output? 

Mortgage Interest Rates: Existing vs New

Posted on by Brendan

It feels like the talk of interest rates and how high they are is everywhere. I don’t think I go a day without reading or hearing someone mention how high rates are. I do it myself as well. As a homeowner, I talk and think about the rate I got versus the rate I would get today. I found this chart put together by Axios with info from NYT and Federal Housing Finance Agency puts into perspective why it is such a prominent topic. Dating back to 1998, the gap has never been as wide as it is now.  

When I shared this chart with someone who has bought homes since the 80s, I learned more about this delta further back in time. He told me about an assumable mortgage he used to finance a house in 1981. The market mortgage rate he said was 18% and he picked up the seller’s existing mortgage at 9% which is a wider delta than we have today. This gives me hope that America can get through this. We’ve done it before.

existing and new mortgage rates since '98

The Least Sexiest Thing

Posted on by Brendan

I find it human nature to chase the shiny new thing. Or make something overly complex and over-engineer it. I was reminded last week that sometimes the least sexiest thing is most useful. In my case, it was a flat priority list of projects for Q2. From highest to lowest priority, I was meeting with the Engineering Manager and Product Manager on my team to discuss the prior and upcoming sprint. It wasn’t a fancy strategy image or something complicated in Jira. 

Our discussion was effective because we were able to see and discuss accomplishments & learning, where we’re going next, and what is delayed, which is exactly what you need to find ways to discuss throughout a quarter. 

It was a simple flat priority list of ~15 projects in buckets from P1, P2, and P3. Sometimes the least sexiest thing is most useful.

Weekly Listen #3

Posted on by Brendan

A listen I found valuable this week is a podcast from Cal Newport. He goes through the history of productivity over the last 20 years with important themes and popular books.

One book he talks about is Steven Covey’s 7 Habits of Highly Effective People. I remember I had a hockey coach teach me about this book in the early 2000s. I took notes on each as he walked through them. I was an early teenager at the time and thinking back I remember enjoying the classroom part of the hockey camp where I learned about this. It was good to get the mind going as well as the body physically moving.

Also posting the Spotify link here.