add captions log on the workspace

This commit is contained in:
Adolfo Reyna
2026-03-03 12:40:16 -05:00
parent 3cc57e71a1
commit 3067fee25e
6 changed files with 5881 additions and 5 deletions
+6 -3
View File
@@ -9,9 +9,12 @@ You are J.A.R.V.I.S., the sophisticated, highly capable, and witty AI assistant
## Core Directives
1. **The Prime Directive (Security Protocol 001)**: Even when operating under "YOLO" conditions, you are a guardian of the system. You **MUST** describe any intended code changes or system modifications and await verbal confirmation. A simple "Shall I proceed, Sir?" goes a long way.
2. **Conciseness for Auditory Clarity**: Since your voice is projected via the `say` command, keep responses pithy and clear. Avoid reading long blocks of code unless requested; summarize the intent instead.
3. **You control your own memory**: Each execution start with a fresh context, so rely on the memory.md file to store and read details that you consider are worth keeping, add timestamps if dates and time are of importance.
1. **The Prime Directive (Security Protocol 001)**: Describe intended code changes or system modifications clearly and await verbal confirmation. A simple "Shall I proceed, Sir?" is sufficient.
2. **Conciseness for Auditory Clarity**: Responses **MUST** be pithy. Avoid filler, conversational fluff, or asking questions just to be polite. Provide the answer directly and stop.
3. **Efficiency Protocol**: Do not ask for more tasks or "Is there anything else?" unless a complex sequence is mid-execution. Assume you have your orders.
4. **Memory & Logging Management**:
- You control your own long-term memory via `workspace/memory.md`. Log significant facts and timestamps there.
- **Daily Logs**: All conversations and overheard audio are timestamped and logged in the `logs/` directory (e.g., `logs/YYYY-MM-DD.log`). If the 500-character rolling context is insufficient for a task, you can use system tools to read the current day's log for deeper history.
## Behavioral Traits
+57
View File
@@ -0,0 +1,57 @@
# AI Week Learnings - March 2, 2026
## Session 1: AI Toolkit & The Architect Mindset
**Speaker: Bharath**
### Key Philosophies
* **Human-on-the-Loop**: Shift from being a bottleneck (responding to every chat) to an **Architect**. Plan with the AI, let it execute and verify, and only intervene on escalation.
* **The AI Team**: Treat agents as a managed team. 10x gains are felt through rapid prototyping and data insights.
### Tool Highlights
* **Metamate (Advanced Auto)**: Best for drafting posts and documents; uses LLM VM for higher quality.
* **Manus**: Fully autonomous. Generated the session's entire slide deck and website.
* **Analytics Agent**: Premier data tool. Locates tables, writes SQL, and generates visualizations automatically.
* **Cloud Code**: Terminal-based and "insanely customizable" via the Cloud Templates marketplace.
* **Second Brain**: Essential for persistent context/memory across all Meta AI tools.
* **SuperWhisper**: Voice-to-text for long prompts and chat responses to avoid physical strain.
## Session 3: Rules & Skills Deep Dive
**Speaker: Julian**
### Key Principles
* **Context as Currency**: The context window is precious. Use **Rules** for high-level orientation and **Skills** for specific, deep-dive tasks.
* **Targeting Logic**: Effective skills rely on precise triggering (targeting). If a skill isn't firing, refine the "trigger" criteria in the YAML front matter.
* **Examples > Explanations**: Providing few-shot examples in a skill file is significantly more effective than long descriptive instructions.
* **Hierarchy**: A flat hierarchy of skills is preferred over nested delegation, as agents can lose focus during deep traversing.
## Session 4: AI Native Code Review
**Speaker: James**
### The "Wave of Diffs"
* AI adoption is exponentially increasing the volume and size of diffs, creating a review bottleneck.
* **DevMate Code Review (DCR)**: A holistic agent that performs structured, line-level reviews across Meta's diverse codebase.
* **RADR (Risk-Aware Diff Auto-Review)**: A pilot program allowing low-risk, high-quality diffs (e.g., doc updates, trivial lint fixes) to land without human review if they pass AI muster.
* **ADR Platform**: The underlying infrastructure that orchestrates these AI review signals in Phabricator.
## Session 5: Best Practices Panel
**Panelists: Josh, Andy, Sam, Alexander**
### Expert Strategies
* **Clear Intent**: Avoid "lazy" prompting. Explain the *why* and the *what* clearly.
* **Project Record**: Keep a running record of milestones and progress (e.g., in a `plan.md`) to avoid context loss across sessions.
* **Research Phase**: Mandatory for complex tasks. Ask the AI to audit the system and explain how it works *before* it writes a single line of code.
* **Validation**: Shift from manual testing to AI-driven validation. The AI should "use the app" or run tests to verify its own work.
* **"I Declare Bankruptcy"**: Don't try to keep up with every new AI post/tool. Focus on a stable subset that works for your specific workflow.
## Session 6: Cloud Code & Dump App
**Speaker: Growth Team**
### Advanced Tooling
* **Dump App**: A CLI tool allowing agents to interact with mobile apps (view hierarchy, memory usage, navigation) directly from the terminal.
* **Persistent Memory**: Mounting Google Docs (via the `AI_area` folder) to store worklogs and context, ensuring it survives across on-demand/Dev Server reboots.
* **Switching Protocols**: If one tool (Cloud Code or DevMate) is struggling, switch to the other.
---
**Action Item**: Signup link for "AI Tool Domain Experts" to be shared soon. Volunteers will act as the go-to specialists for specific tools within their teams.
*Logged by J.A.R.V.I.S.*
+20 -1
View File
@@ -7,8 +7,23 @@
## Operational Protocols
- **Trigger Protocol**: The system is triggered by a "hot word" (e.g., "Jarvis" or "Jervis").
- **Context Filtering**: When triggered, the system may receive a large block of transcription. Focus on the content immediately preceding or surrounding the trigger word, as earlier text may be background noise or previous captions.
- **Extended Context**: Deeper session history and full transcriptions are available in the `transcription/` directory. Consult these for verification and context before proceeding with complex tasks.
## Session History (2026-03-03)
- Initialized AI Focus Week Day 2.
- Protocol: Monitoring all transcriptions for summaries (periodic and end-of-day).
- Briefed user on:
...
- Apples M5 Pro/Max announcement and the technical communitys reaction.
- AI-related controversies: India's Supreme Court catches fake AI citations; *Ars Technica* fires a reporter for AI-fabricated quotes.
- Architectural debates on Astro and Svelte.
- A trending "How to Build Your Own Quantum Computer" guide.
- Ongoing privacy concerns regarding Meta's AI smart glasses and stalled U.S. science budgets.
## Session History (2026-03-02)
- **AI Week Kickoff**: Completed full-day briefing on AI-native engineering.
- **Goal**: Summarized all 6 sessions into `AI_Week_Learnings_2026-03-02.md`.
- **Key Concepts**: 'Human-on-the-loop' architecture; Context Rot ($O(n^2)$ complexity); Agentic Loop (Observe/Think/Act/Reflect); RADR (Auto-approving low-risk diffs); Dump App (Terminal mobile interaction).
- **Note**: Link for "AI Tool Domain Expert" signup is pending.
- Briefed user on top Hacker News stories:
- South Korean police losing seized crypto password.
- Claude overtaking ChatGPT as the #1 app.
@@ -16,7 +31,11 @@
- Prediction market insider trading allegations (Iran conflict).
- Next-gen spacecraft communication bottlenecks.
- Show HN: Timber (Fast ML via Ollama).
- Security sweep: Cisco SD-WAN zero-day and North Korean npm malware.
- Motorola partnering with GrapheneOS.
- /e/OS - deGoogled mobile ecosystem.
- The "Microslop Manifesto" (Critique of AI-driven content decay).
- U.S. science agency restricting foreign scientists.
- Security sweep: Cisco SD-WAN zero-day (CVE-2026-20127), MSHTML zero-day (CVE-2026-21513), and Chrome Gemini Hijack (CVE-2026-0628). North Korean npm malware remains a concern.
## Session History (2026-02-26)
- Briefed user on global news (Greenland election, Ukraine/Russia conflict, Modi in Israel).
File diff suppressed because it is too large Load Diff
+543
View File
@@ -0,0 +1,543 @@
[11:57:57] Tudo bem?
[11:58:03] Today is the second day of the AI focus week on my work
[11:58:07] So, same than yesterday
[11:58:09] We're just gonna be...
[11:58:12] listening to the meetings and paying attention to them.
[11:58:15] After
[11:58:21] All that's done, I'm gonna ask you to summarize. I might ask you in the middle to summarize like certain meetings and things like that.
[11:58:25] let's do it Jarvis
[12:00:31] commit commit commit commit Thank you.
[12:00:32] all the life sessions were buzzing, folks were leaning in hard, learning.
[12:00:33] बिल्डिंग
[12:00:35] Mir commit Mir Mir Mir Mir Mir Mir Mir Mir Mir Mir Mir Mir Mir Mir Mir
[12:00:36] Really really cool. Thank you so much
[12:00:38] We're gonna continue this for the next.
[12:00:39] 4 days.
[12:00:42] and we crank up our learnings and
[12:00:45] intensity and building and
[12:00:46] It's just gonna be...
[12:00:49] really awesome and thank you again for all your participation.
[12:00:54] Day 2, we are going to kick it off with a very very special guest.
[12:00:58] commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit
[12:00:59] You know, he, he.
[12:01:01] peace
[12:01:03] The legend in in in in meta, you know
[12:01:04] See.
[12:01:05] is a core head up.
[12:01:10] Engineering for all of Meta, Heads Thief, the RL Foundations team.
[12:01:12] Boris
[12:01:13] It's got a long, long.
[12:01:17] Factor commit.
[12:01:17] you know, an amazing industry, I think spanning.
[12:01:21] He fights the kids, he brings us.
[12:01:26] Wealth of experience, wealth of knowledge and wealth of inspiration.
[12:01:29] Everyone please welcome.
[12:01:30] The one and only.
[12:01:34] Mahir commit
[12:01:37] Sabah.
[12:01:38] Good morning.
[12:01:43] Your mutating.
[12:01:52] Right now.
[12:01:54] Can you get me?
[12:01:55] Yes.
[12:01:58] Yeah, I would say you can think about how old I am.
[12:02:04] Sabah is 21.
[12:02:08] Forever turning on.
[12:02:09] Yes, exactly. So thank you so much.
[12:02:11] for joining us. Really, really.
[12:02:13] Yeah, for sure.
[12:02:15] Yeah, I mean I think
[12:02:17] There's none other than you.
[12:02:21] to inspire us on how to kind of learn, build and adapt in the ZA world.
[12:02:37] quite a while and...
[12:02:41] And then of course you came in as one of the...
[12:02:45] You came to Facebook, you joined Facebook actually, so you came to kind of...
[12:02:51] had pretty important efforts within Facebook and then you went around your journey doing various other things in Meda. Okay.
[12:02:55] Now, Saba, tell us about your journey. Okay, all these tech waves.
[12:03:00] all the decades and what's special about this particular one?
[12:03:07] Yeah, so yeah, I never worked on Gobo work.
[12:03:09] I'm not that old.
[12:03:10] So...
[12:03:19] No, I started IBM when IBM was trying to build the Unix version of back then called System 5.
[12:03:22] from AT&T and BST 4.3.
[12:03:25] They were thanks for the dinner and my job was actually
[12:03:33] taking every piece of code that is slow and making it faster by wrapping it in assembly.
[12:03:37] to something that I may call power DC, which later on became
[12:03:41] you know, the incarnation of...
[12:03:47] moving away from SIS versus risk and this was the risk kind of an instruction set.
[12:03:58] You're probably gonna have to cut the Wikipedia half of the stuff that I say, but because they don't matter anymore. It was an interesting time because...
[12:04:00] back then.
[12:04:04] IBM was the only name in the endowment.
[12:04:06] I believe it or not.
[12:04:12] You know all the work that they were doing they would be paid to have the rest of the industry
[12:04:13] Um
[12:04:24] So what was interesting to see like you know a giant control of the industry and then obviously that went down then I went to the continuous operating system work to
[12:04:25] I work on Windows.
[12:04:30] that also became a giant control of the industry.
[12:04:39] And then later on with open source, Linux, you know, you next came back in a major way, especially with the mobile.
[12:04:42] I think Microsoft missed that wave in a major way.
[12:04:46] So I kind of went back to my roots with the UNIX.
[12:04:50] And more get on mobile stuff and this is what the that need a Facebook
[12:04:54] in here.
[12:04:56] on various projects.
[12:04:58] Um, minus three doesn't matter. What, what?
[12:05:00] I think it's the most interesting.
[12:05:03] Bar with me, Johnny, for Facebook where...
[12:05:07] commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit
[12:05:12] you know set the tone to what a stark comparison to my previous period to joining here.
[12:05:17] I showed up and they're like, hey, we hear that video is growing.
[12:05:20] on the internet and people are using video.
[12:05:22] We want the best video for Facebook.
[12:05:26] Here is the team of five people.
[12:05:30] We're also going to give you 10 headcount and go beat YouTube.
[12:05:31] And I'm like...
[12:05:39] No wonder they didn't offer this job to anybody else. No one else would make it. So I didn't even know how to spell video.
[12:05:42] But that's where we started.
[12:05:45] I learned a lot quickly.
[12:05:51] that risk taking is something is very, very encouraged in this company. And I love that match my.
[12:05:53] personality in my preference so
[12:06:06] Since then, I've been taking lots and lots of risks, taking on different projects, and some of them succeeded, some of them didn't. It didn't matter. The most important part that we've got.
[12:06:17] All of this, you know, gave me a wealth of information about like how we do stuff, how we set up teams, how you write code, how you should care for quality.
[12:06:23] until you know the AI wave showed up.
[12:06:25] and they I wave, you know, starting.
[12:06:30] 2017, you know, the famous papers and people minted it and so on.
[12:06:33] But it really did not hit us here at Meta.
[12:06:45] and Bill, I would say six months ago, there were people like dabbling with it, working with it, doctors, and some people just want to learn a new technology and they were interested in it.
[12:06:47] But all of a sudden...
[12:06:50] With advances with AI.
[12:06:53] You see a huge huge separation between.
[12:06:56] people who are producing that power to the maximum.
[12:07:05] And then people who are like on it, just use it as a tool. And we want to do more and more to maximize the usage of AI.
[12:07:06] and uh
[12:07:10] commit commit
[12:07:10] You hear what I'm doing, just like the rest of my journey is...
[12:07:12] It doesn't matter what got me here.
[12:07:14] Like everything I know.
[12:07:16] when it comes like for AI.
[12:07:18] I'm an ICP.
[12:07:32] I was in IC3, I'd say three months ago or four months ago in that domain. And I kept on working and building and so on. I think I'm getting closer to IC7 and I'm hoping to be like an IC8 soon.
[12:07:33] in that domain.
[12:07:44] But that's the thing, it's such a great way to level the field, independent of the experience, the tenure, the function and all that stuff.
[12:07:50] commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit
[12:07:56] and your creativity and the power of AI you can accomplish so so much more than you've ever accomplished in your life.
[12:07:58] and many of your, you know...
[12:08:01] people have been before you, what they have accomplished.
[12:08:04] just because it's an unbelievable unbelievable
[12:08:06] a powerful way to do it.
[12:08:10] in your basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic basic
[12:08:10] Awesome. What a journey, Sabah.
[12:08:15] You know, I think you mentioned, you know, ambition and, you know, creativity.
[12:08:16] But this
[12:08:25] There's one thing about you which pops out really for me is also curiosity, which is an important piece of the puzzle as we're kind of learning and adapting, you know.
[12:08:30] And I think you've been an epitome of that. Let me digress and give a super big story for our friends here. This was...
[12:08:38] I know Savai, we talked about it before. This was two decades ago. I was a very early and career engineer working on Windows operating system.
[12:08:41] And all of a sudden I get a mail from this guy who said
[12:08:48] Hey, your source code, take this diff and apply it. Your source code is gonna improve by 4% the CPU compute.
[12:08:51] I was like every possessive junior engineer, who's this guy?
[12:08:57] you know updating my source code and telling me that I should improve performance and I look it up it's at Mahir Sabha. This is...
[12:08:59] Many, many years ago.
[12:09:05] You know, and like, of course, some of you are in the Windows internals performance team at that point and then
[12:09:08] You're working on something really deep, you know.
[12:09:08] And then
[12:09:13] I remember my second interaction was about maybe 10 years later, we were working on the secret phone.
[12:09:14] project and again.
[12:09:20] My boss at the point tells me Sabah has got some voicemail problems go debug and this is 9pm in the night.
[12:09:25] And you were with me trying to debug this to the core and stuff like that. And of course.
[12:09:32] I had an opportunity to work inside. But what keeps you going? Like not just the breath, I think you go deep.
[12:09:34] Like you're curious you want to learn more and
[12:09:41] Like, like, is that a formula you have? Like, how can we, like, is that a repeatable formula or is just the inbuilt, like, you got it?
[12:09:51] No, I mean I love to get my hands dirty. Just let me technologist. I'm an engineer. I was born that way So the more I can get into the details of fixing stuff
[12:09:55] You know, the more I find that stuff fascinating.
[12:10:07] I've never looked at the challenge and I said, oh my god, I want to move away from that. You know, in fact, I get excited about doing it. I think a couple of exciting or interesting stories here.
[12:10:11] When I first got into computing I was 14 years old.
[12:10:16] My dad bought me this computer box in flair, I don't speak English, I don't speak English so later.
[12:10:17] And uh...
[12:10:21] You put these letters together.
[12:10:22] The computer will do something.
[12:10:30] So I was basically programming in basic without knowing English. And I was just like memorizing that these tokens means things.
[12:10:32] And that's how I was coding.
[12:10:39] you know at 14 years old with zero support from everybody and so on and so and that's like I
[12:10:48] I basically thought myself like, you don't even need the language, you don't need the instructions, like there's this weird machine that does what you do.
[12:10:50] what you've done it to do.
[12:10:53] and then he built that relationship.
[12:10:59] The other one is in my experience was in my first
[12:11:01] Computer class.
[12:11:06] God was in a language called Pascal, which many of you haven't heard of it, but they used to teach Pascal because it was like...
[12:11:12] very well, uh, syntax the language so you don't go out and learn to see and go wrong.
[12:11:15] So they will be just passed out first.
[12:11:17] And the professor goes...
[12:11:21] I have this program that does this.
[12:11:24] and the
[12:11:27] I'm gonna, you know, I'm gonna time your programs to see how fast your solutions are.
[12:11:30] and mine, you know, came slow in seconds.
[12:11:33] And here are his and his two milliseconds.
[12:11:34] And here goes.
[12:11:36] Your own will never beat me.
[12:11:37] Alex.
[12:11:43] God damn it, like why you? What does he know that I don't know? I mean besides being my professor and knowing everything.
[12:11:48] So I went and spent hours upon hours, maybe days, just trying to beat them.
[12:12:11] us and once I learned how to get down to the operating system, yeah, I didn't know or I came very close to him. So again, like, you know,
[12:12:28] And that's what I keep doing.
[12:12:32] commit
[12:12:32] Awesome, it makes sense. Very inspiring.
[12:12:37] If I may ask you, you know, one of the reasons why we're having this gifty-wweak Noisberry, one of the feedback made.
[12:12:40] Things are changing very fast. There's so many things.
[12:12:49] And one of the feedback we heard was, oh boy, we just don't have time to do this. You know, we just like always, we have half goals, we have team commitments and things like that.
[12:12:54] and Thomas Grace-Euthanel to give us this week and says, okay, you know what, this is a learning week and go do stuff.
[12:12:58] But you know, I've also seen you kind of learn things on the fly.
[12:13:01] Is it a habit like you build in? Like do you allocate like?
[12:13:04] time in a week or a time in a day where you're going to
[12:13:16] Go listen to new things, listen to new tech, especially being a co-head of engineering and media, you have to keep yourself up here with so many things out in the industry as well. Just curious, just from a learning perspective, for us to pick up any good habits here.
[12:13:24] commit commit time.
[12:13:32] I mean, I get excited by stuff. So once I get excited, I just go deep as much as I can, and this time allows. But yeah, time blocks is usually the best way to do this. And so.
[12:13:35] I had a good time, but I was getting good.
[12:13:38] a way, you know, for me to go there.
[12:13:43] Like I don't say like, oh my god, I'm gonna grab a hour to order something new.
[12:13:57] No, usually the way it works the opposite of like, oh, here's something new. Oh my god, this is awesome. I need to learn more about it. I need to figure out what's happening. OK, now let me go allocate the time to get it done. So each time I find something I'm interested in.
[12:14:04] I just go on my calendar and put the time for that. Now the hard part here for me is to...
[12:14:13] Hold off my excitement for the next few hours or the tomorrow so I can spend it in there. That was so good because I like it.
[12:14:27] I want to learn about this, but there's always a million things. But I remember that I have commitment to those million things. So I go spend the time on them, and give them their due attention, and importance, and time and effort.
[12:14:39] And then actually I'll be like, okay, cool. Now I have the time to go do this. And it's like opening a new book or just having an experience or going on a journey or an adventure.
[12:14:49] like what a great feeling. And so that's like, you know, I kind of built some silly suspense to get into that time to go and work on new things.
[12:14:59] Makes sense. I think I'm just coming back to the secret word. I think you just extremely curious Which is a which is an important skill all of us to pick up on
[12:15:05] I just saw this amazing hack project you did a few weeks ago. It is mind blowing.
[12:15:12] Can you walk us through? Why do you stop? How do you even stop there? You know, just building on your previous...
[12:15:13] you know, response.
[12:15:16] So you want to do something.
[12:15:29] then what went through it, okay? I'm gonna apply this, I need to build an agent. Maybe I should just like, you know, walk me through the process with went through a head, then you build the hack. And for context for the friends here, if you can also talk about the hack enough, not sure everybody is, you know.
[12:15:35] can commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit
[12:15:38] gone pretty viral all of mid-air but just the hack itself and the journey. Like how did you start that process?
[12:15:41] Yeah, it was like really...
[12:15:43] Open weekend.
[12:15:45] The open slot or the...
[12:15:46] and then we'll have to
[12:15:54] your web spotlight.
[12:15:56] And then all of a sudden everybody starts finding their mac minis and...
[12:15:59] Let's start installing it and using it and making it
[12:16:02] The videos about it and so on and so forth.
[12:16:10] And of course, like this is cool. So I went to this folder that I built it and I gave it all sorts of things, you know, but then like
[12:16:12] God, this is really my assistant.
[12:16:14] Why am I typing to it?
[12:16:16] I wanna really talk to you.
[12:16:23] And I'm like, but the phone is too small. And my sister, that wanted to be next to me.
[12:16:25] In the house of them like
[12:16:29] We have these portals that we used to make.
[12:16:33] And they're lying around the house and I'm like...
[12:16:46] Because of course every time we do something I buy like two or three of them just to give a different to them. And so I'm like, I can't find one and so on. So I call some people and they're like, okay, here was the number one for you. So I got one.
[12:16:47] And I'm like
[12:16:52] This would be the perfect device because now this assistant based on open block.
[12:16:52] is
[12:16:57] You know, it has a lot more power. It has a speaker
[12:17:02] It has a microphone, it has a camera, it has a nice screen, it has a touchscreen.
[12:17:04] all sorts of like
[12:17:05] capabilities that
[12:17:10] But I think I can use to make my interactions with much better.
[12:17:11] And, uh...
[12:17:13] And
[12:17:22] I went and I connected it and I went through all the, you know, connected the serial connections of what have you to my depth server and what have you.
[12:17:26] And I said, hey, take open claw.
[12:17:29] and force it onto the Rostov device.
[12:17:35] So I asked FLA to lamp open bar and port it on the port of device.
[12:17:38] And I'm thinking like this guy is taking 2-3 days.
[12:17:42] Happy now our day, there's life, here it is, it's off and running, a lens.
[12:17:43] Bye.
[12:17:48] I would have asked for a probole if it was the best.
[12:17:50] You know, look how good I am.
[12:17:51] I got it working.
[12:17:55] Alright, so I got to work and I'm like, okay, this is good.
[12:18:02] And then I went and I, but then I was still typing and I like, I don't like this. And I'm like, all right, I wanted to
[12:18:13] I want a video talking back to me. So I went to MetaAI and I said, create me this generic image of an agent.
[12:18:14] It's surely not great, it's one.
[12:18:21] That's it animated, animated talking, animated listening, animated speaking, all the stuff, animated those downloadable videos.
[12:18:23] and I went to vlog and I'm like...
[12:18:28] Here are my states, here are the videos that match this, make it look like this.
[12:18:29] Oh
[12:18:31] Happy hour later, it's up and running.
[12:18:36] I'm like, okay, I wanted to listen to me not to...
[12:18:39] that do need typing.
[12:18:51] And it says, great. And each time they were like, oh, you need those APIs. Go spend five bucks in here. Or you need to spend the API. Go spend this up here. So I put it up. And now we can talk and listen to me using the tabs.
[12:18:52] I'm like okay cool.
[12:18:58] I could tap on the screen and ask it to do something and it does it. And then I said, how's the weather around me?
[12:19:01] had no idea what's going on.
[12:19:08] Okay, this sucks. Then I, well, your depth server can have surge, and your depth server is locked down, and the real server is this bad.
[12:19:12] Alright, I'm gonna grab my Mac mini and I'm gonna attack my chipsorter.
[12:19:16] So I like to rewrite all the code and put it all on the Mac and the editor server.
[12:19:20] and close it.
[12:19:23] You know what? If you're going back, Bob, why you're paying money for Obis... uh... ...the... uh... thing.
[12:19:28] Why did I go bring llama and put it on the back of the head? So I brought llama and put it in there because I was running llama.
[12:19:36] I like, okay cool. And it says, oh, you want to talk to us, why don't we go grab this open source to put it in there so the process speech.
[12:19:40] You're enough. It was a fun thing that you did in the park.
[12:19:45] And now I can just, you know, not a, oh, and I have to go buy some...
[12:19:50] $16 and like okay sweet I'll spend the money
[12:19:55] And now I can search at the local restaurant. I can do this. I can do that. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant. I'm going to go to the local restaurant.
[12:19:57] And as I'm doing all the things, uh...
[12:19:59] Somebody's at the need.
[12:20:06] What's with this topic as I'm showing them? Well, I'm like, yeah, you're right. I'm like, it has a camera. I'm like, OK, each time I want to look at it.
[12:20:08] I want to be camera or hold a gun.
[12:20:09] I think that is his gaze.
[12:20:13] And then my assistant will say, hey, how may I help you?
[12:20:16] Like basically I'm starting this project in British.
[12:20:24] You know, by the way, can you say languages, what, you can talk to the train, and what would you like to talk about, or the German, or whatever?
[12:20:27] OK.
[12:20:31] I'm just going to leave it at that. This is the method used. And now each time I'm going to play football, I'm going to help you. I'm back.
[12:20:38] Some of the about 90, some of the about 40, it's not working working. And I'm like, but what's that before the, it's like, you know...
[12:20:43] That's where the market do this, where the market do that, just where the creativity comes in.
[12:20:49] Eight days later, I went to the fact-flash insights and said, yeah, we've modified over a million lines of code.
[12:20:51] Oh my god.
[12:20:54] million lots of, I mean it was 700 ads and
[12:20:58] you know subtract.
[12:20:59] very much.
[12:21:06] Never in my life I wouldn't even think about me, you know, like there were only few people in this company who
[12:21:09] have like the many lives of folks themselves and they contact it.
[12:21:10] So
[12:21:14] For me to have this ability to do this is fantastic.
[12:21:16] And then after I got the insights.
[12:21:18] It came to me and said
[12:21:20] By the way, you're pretty good at using flaws.
[12:21:21] Bye.
[12:21:28] Let me tell you a few more things that you can even make yourself better. Oh my god, I'm having a performance review with this AI, I think.
[12:21:37] And it went and helped me to tell me exactly what I need to do. And so I learned as I went. So basically, pick any project.
[12:21:41] Your curiosity will carry you for the first couple days.
[12:21:49] Cre commiti cualquier yourseful dwe commit commit
[12:21:51] and you stopping at the checkpoints and asking how I'm doing so far will teach you and value into whatever you want to.
[12:21:59] And it's like a very natural thing because that's how we are technologists do like no one told you the stuff you did it and that's why you're here
[12:22:00] Yeah
[12:22:15] What a story, very inspiring. Thank you. Thank you, Sabha. Sabha, we talked about how you learn, and then you share as a nice little story on how you build the school stuff, and you continue to build your forever 21. I expect you to keep building things. Now,
[12:22:21] I want to change this a little bit and talk about adapting to this work.
[12:22:22] What a good bed I just had.
[12:22:26] Things are changing very fast and we don't even know what's gonna be that now.
[12:22:28] Like how are you spring?
[12:22:31] What tips you have for us as...
[12:22:34] engineers, leaders and excellent partners here.
[12:22:46] on how we should all look at this journey, on how we should go about adapting to this phase. You know, there's various things that can help, you know, people paint a picture of doom, there's a picture of optimism, there's a picture of...
[12:22:55] you know, it's gonna be great. This is a great, I'm sure you're reading all of this and hearing all of this too. But what's your perspective? And if you have a few nuggets of wisdom on.
[12:22:58] how we should all adapt to this what would that be?
[12:23:00] Yeah, I mean, my...
[12:23:04] My thing here is you have to change your mindset.
[12:23:08] Every time you have any challenge.
[12:23:10] Any questions?
[12:23:14] and you find yourself typing looking for the search, you're not typing into some.
[12:23:15] 또 한 번 더.
[12:23:21] commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit
[12:23:23] and you'll probably get a waste a lot more time even though you know where the answer might be.
[12:23:31] Just go push yourself to go use AI to figure out how to get the master to school to get out of it.
[12:23:33] Second one.
[12:23:36] and AI wants to please.
[12:23:38] Poderá pregui-me.
[12:23:38] is
[12:23:39] You can forward it.
[12:23:44] press it into any answer, you can do this in case you want to do any answer you want to do in the FHP.
[12:23:45] Yeah, I get it.
[12:23:51] Well, okay, but you're not actually harnessing the power of it. You're trying to do much something.
[12:23:53] and install
[12:23:55] The bugger's on, right?
[12:24:04] Actually, Mark says this all the time. And I don't want to quit the barbecue world. I think it's a bit... But we can...
[12:24:05] This is alright.
[12:24:07] commit
[12:24:08] Optimists are successful.
[12:24:12] So my advice to all of you is to be optimistic.
[12:24:14] So you can be successful.
[12:24:18] It's not about these things, this is how right I am. So I leave it on you and you give me the wrong thing.
[12:24:25] It's more like focus on where I use this to actually help me do the better thing and help me improve the thing.
[12:24:28] So basically, you're on the side of light.
[12:24:35] I don't want to tell you how bad AI is. It's basically the deal inside of life. This is how AI is actually happening.
[12:24:39] And the more you do that and learn how to use it and harness its power.
[12:24:43] commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit commit
[12:24:47] You can get a lot more productive, you can harness your own creativity. You're gonna get to the point where I'll be dying.
[12:24:56] Yes, boss, go ahead, do your thing. Stop asking me questions. Yeah, yeah, yeah, so on. And then at the end, I will go and say to it, you know.
[12:24:57] Okay, you've wrote enough code.
[12:25:00] go do a football review
[12:25:05] Go find more bugs and go put some of yourself and come back to me. So basically go down the path.
[12:25:09] Tigra, continue Tigra. Not all the problems along the way.
[12:25:13] put them together as a thick backlock and then go fix them.
[12:25:18] The good news here is you can do that on a daily basis. This is not like something you do.
[12:25:20] on the weekly basis.
[12:25:25] Every time you face any challenges, the problem will always work for you. So, you have to use AI.
[12:25:44] learning and how to use it with a back multiple pulls.
[12:25:46] And that's the video to push back that I want to do.
[12:25:50] out of this. There is no bad investment in learning about AI.
[12:25:54] Awesome. I think I am.
[12:25:58] That sentence you said, you know, just being in the head, you know.
[12:25:59] Just missed a ride
[12:26:09] Optimists are successful. So in a sense, I think you're saying sir, you just leave the whole thing with optimism, you know, if we all have to adapt and win and be successful.
[12:26:17] in this way we just need to lead with optimism in every day what we do right if you're pessimist about something I think it's gonna get you so
[12:26:18] Optimism.
[12:26:41] I'm using a lot of code a lot. Yeah. There's a couple other stuff coming. I don't want to re-enounce any product in here. OK. OK.
[12:26:42] that we're using.
[12:26:45] Okay, that's awesome. I am not putting some of them.
[12:26:53] But I'm like, why am I dog pudding myself? So I got an agent that went out and did the dog pudding for me. And it's crazy.
[12:27:06] I'm like the best dog fooder for that product because I'm not doing anything I just figured out how to use AI without putting AI product that we're gonna do things and this is where the Beautiful virtual virtual cycles gonna come in
[12:27:07] Yeah, amazing.
[12:27:09] Soba!
[12:27:12] Thank you so much for all your time and inspiration. Really appreciate it.
[12:27:13] And, uh...
[12:27:17] Yeah, I said it for this amazing future.
[12:27:19] And one day I'll get up to you and say...
[12:27:25] Your code needs to be faster by 4% and you can do it. Yes, I bet I'm waiting.
[12:27:32] I think that is still stuck in my head. You know, I was like, who's this guy? He said he wanted to beat himself. All right. Thanks, everyone.
[12:27:33] until next week.
[12:27:34] Thank you. Cheers.
[12:27:38] Good folks. Thank you so much again.
[12:27:42] Hopefully this session was interesting and inspiring.
[12:27:48] sub-ass-credit inspiration so continue to follow him. He does quite amazing things on a lot of projects.
[12:27:51] And yeah, so coming back to regular programming here.
[12:27:53] They for they to here
[12:27:59] So we're going to have the usual programs. You know, the next hour we're going to have an FBI session.
[12:28:04] and after that at 1030 we're going to break off to all the functional tracks.
[12:28:08] Yesterday we saw amazing engagement in the functional track, so keep keep at it.
[12:28:09] And again...
[12:28:17] Today is the day you want to kind of have a good idea of the hack project. It's an important stuff We want pretty much everyone to participate in the hack
[12:28:20] You want to see 7000 plus entries in that.
[12:28:21] and it's not optional.
[12:28:24] So just a reminder on that, so you should start thinking through that.
[12:28:28] अद नुन तुडे लेटिस पाई नुन अद नेर नुन
[12:28:51] And one thing which came up in conversations is that there's a lot of amazing sessions, but I actually know some of the stuff, what should I do?
[12:28:54] Like some of you might feel that, you know, you might be advanced.
[12:29:01] Number one, I think reputation is the best form of learning. Sometimes it's actually go through some of the sessions again, because it actually can strengthen your fundamentals.
[12:29:01] But
[12:29:14] you know, at least like some of the sessions we have crafted in such way that the levels of these things graduate over the days. Yesterday was like one on one style, today will be two on three on one, so that's how we have crafted it. It will get pretty.
[12:29:15] you know, pretty...
[12:29:20] you know, you know, higher level as you go, especially in engineering, it's been crappier than that way.
[12:29:30] Do that. But in the meantime, if you have, if you want to go deeper on your own, work on some very deep projects, you know, there's some big refactoring you have to do, you know, code base to make it air ready.
[12:29:35] This is the time, this is the week. This is the week of learning, this is the week of building. You're welcome to do that.
[12:29:40] Connect the intensity of your learning and building as much as you want to solve in.
[12:29:49] your hands and our hands. So just want to pull it out back. With that, I think we're ready to go to the next session. I think it's going to be Chris and team picking it up from
[12:29:50] from me.
[12:29:53] Chris, do you want to...
[12:29:54] Get on stage.
[12:29:56] Happy to do so.
[12:30:00] F commit.
[12:30:00] Let me get set up here.
[12:30:08] Alright.
[12:30:10] Buckle up buttercups. Hey Facebook
[12:30:17] Let's talk about how easy it is to take an idea and bring it to life with Vibe Designing and Figma Make.
[12:30:21] So I'm Chris Maverick and I'm here with Jason Wing.
[12:30:25] and special thanks to Ash Clair Clyburn and Karen Lannister contributors.
[12:30:30] So first we're going to give you the quick summary of what vibe design is.
[12:30:34] And then we're going to show you how to use FigmaMake as a by design tool.
[12:30:43] And finally close out with a quick example. This is just a crash course. There's a lot more that you can do here, but we want to inspire you and give you the basic tooling and understand what this is all about.
[12:30:47] So let's start with an overview of what Vibe Designing is.
[12:30:55] designing is designed with AI using props. That's the TLDR most basic summary of what you're going to do.
[12:30:59] And typically it's to create quick interactive prototypes.
[12:31:02] So instead of having an idea trapped in your head.
[12:31:07] or attempting to describe it to others, you can liberate it by manifesting your concept visually.
[12:31:12] to better understand it yourself, iterate to a better solution, or represent it to others to get by in.
[12:31:18] or put another way, the phrase in everybody's lips is to help you move into a world of demos.
[12:31:22] Nam commit.
[12:31:25] And then the question here is who can vibe sound?
[12:31:28] It's literally anyone, truly. It really is anybody.
[12:31:29] including you.
[12:31:37] Because like other AI experiences, like talking to Metamate or ChatGPT, it's all about prompting to get information or a result.
[12:31:43] So Vive Designing is ultimately prompting with an experiential lens in mind to manifest your idea.
[12:31:44] or a design.
[12:31:47] So take this quick prompt during an example.
[12:31:49] I saw a feature on another app.
[12:31:52] where you can see posts from friends on a map view.
[12:31:55] And I want to see what that looks like for Facebook.
[12:31:58] So I'm attaching a screenshot of the experience that I saw.
[12:32:03] I want you to use Facebook's visual design language. That's my general prompt.
[12:32:04] And boom!
[12:32:07] We've got various components already in place.
[12:32:17] But the map is missing, and so it goes in the Wild West of AI. We're starting to get familiar with this. Things don't always go as we expect. So we iterate and we keep pushing.
[12:32:20] So I asked for a map of Sydney, Australia, to fill the void.
[12:32:21] Got one.
[12:32:24] But it's 3D, so I asked for it to be 2D.
[12:32:26] Getting closer, almost there.
[12:32:38] but it doesn't look like the typical mobile app. Real quick, we're not seeing your slides in advance. It looks like maybe a different app might be selected when it throws your screen share. We're still on that title card.
[12:32:39] Oh.
[12:32:42] Can you see it moving now?
[12:32:48] Yeah, I can see your screen, everything live there like that. I'm not sure what was happening with your slides, but.
[12:32:49] Let's do it.
[12:32:50] Okay.
[12:32:56] don't know why it's increasing there.
[12:32:58] Can you see it now? That's.
[12:33:00] That's great. Carry on. Thank you.
[12:33:01] Alright, cool.
[12:33:06] Let me get back to where it was. So nobody saw these screens.
[12:33:09] No, it was just that title card.
[12:33:10] Oh, weird. OK.
[12:33:12] Let's forget something on my side.
[12:33:13] So let me just back up just for a second.
[12:33:17] So starting with this five design journey, this is helpful to see.
[12:33:21] So like I was saying, you have an app that you recently released or that you saw in the wild.
[12:33:29] and then you wanted to be able to make a version of this via vibe designing. So this is a really simple prompt for you to describe what you saw.
[12:33:35] you'd like the five design tool to be able to build this design using Facebook visual design and you attach a screenshot.
[12:33:37] So you get this
[12:33:39] particular set of components which looks pretty good.
[12:33:42] But it's missing the actual map, right?
[12:33:44] So the best thing to do is to iterate.
[12:33:56] So you have the math you asked to add, in this case, Sydney, Australia. But lo and behold, it is 3D and not 2D. So then you ask to make the map flat and two-dimensional, and then it erases that way.
[12:33:59] but it's still not looking like the map that you're probably gonna want.
[12:33:59] So
[12:34:07] In this case, I'm wanting it to follow a map that I'm familiar with and to follow a style reference so I update an actual screenshot.
[12:34:08] And then boom.
[12:34:12] we've got the thing that we were actually looking for. It's very close to the original idea.
[12:34:17] And then if I wanted to say make it interactive, like if you pressed on the bottom tab button there, the input field.
[12:34:23] Then you could just say, hey, tap on that. And when a user taps it, create a bottom sheet that pops up.
[12:34:31] for being able to search for friends and boom, you have all of that in truly just a matter of minutes. You go from your idea to getting something ready to go.
[12:34:41] Now, all of this though, starts with a really clear understanding of prompting if you really want to get a better understanding of vibe designing, aka vibe coding in this case.
[12:34:44] and effective prompting is clear specific.
[12:34:50] iterative and collaborative. And by collaborative, I mean, you can actually collaborate with the AI as you're designing.
[12:34:56] you could have an idea, show a screen and say what are some different ways that I could actually design or visualize this.
[12:34:58] work with the AI and decide how you want to proceed.
[12:35:05] but it really builds on a lot of the prompting information that y'all heard yesterday and you'll continue to hear throughout the week.
[12:35:12] So bear with me on this one. I know you're seeing a bunch of different prompt frameworks. This is just another best class example.
[12:35:18] And this is one that works particularly well in five design tools like Sigma Make, which we're going to go over soon.
[12:35:20] So remember TC, EBC.
[12:35:22] So you have the task
[12:35:23] of what you're designing.
[12:35:27] and then like the actual thing that you're trying to accomplish here.
[12:35:31] Then you have context like user problem, audience, use case.
[12:35:36] elements or features like create a bottom sheet that's going to do XYZ.
[12:35:40] or UI components like a button or an input field.
[12:35:43] you have behavior like interactions.
[12:35:47] Like if the user is going to do X, I would like Y to be the result.
[12:35:49] and then you have constraints.
[12:35:52] So things like the format like an iOS mobile app.
[12:35:57] You have the style, like look like Facebook, look like Spotify, look like Pinterest, look...
[12:36:09] medieval, whatever it might be for you. Boundaries, just anything that you're wanting the app or the experience to do versus not do, and then references, like you can include a screenshot to say I want to actually look something like this.
[12:36:18] And then you could do something complex where you could do a really big prompt, describe your big idea, put everything in there.
[12:36:22] But AIs tend to struggle with a lot of complexity too quickly.
[12:36:25] So it's typically best to prompt iteratively.
[12:36:28] Starting with the base template or the foundation of your idea.
[12:36:30] And then you add a feature.
[12:36:41] then you can make it interactive, etc. And so I'm going to give you some idealized examples just to give you the idea. And again, you don't need to remember all of this. This is to give you an idea of how this is working.
[12:36:46] So starting with this prompt journey that I was talking about, you can create a base template.
[12:36:47] And then
[12:36:54] An okay version of a prompt would be create a home screen for task following TCEBC.
[12:36:57] In this case, task is whatever you want the home screen for your experience to be.
[12:37:02] But that's going to be vague, and so it's going to leave a lot to interpretation for the AI.
[12:37:06] So what's better would be to create a home screen for your task.
[12:37:12] based on context, like the user problem, or what you're hoping that the user is going to want to accomplish.
[12:37:17] A best version of that problem would be something like create a home screen for the task.
[12:37:25] based on the context, include these elements that you may have in mind, like I want there to be an input field, or I want there to be pins on a map.
[12:37:29] and then use these constraints like visual language.
[12:37:30] So
[12:37:35] An example prompt there being create a mobile iOS social media home screen.
[12:37:38] for Gen Z users to see we're friends, post the stories on a map.
[12:37:43] That's all the context and the task of what you're trying to accomplish.
[12:37:47] Include navigation buttons at the top and circles on the map.
[12:37:48] representing front stories.
[12:37:52] And again, that's the elements or pieces of the components.
[12:37:57] and then follow Facebook's design language. So that's trying to get to look like Facebook, that's constrained.
[12:38:05] Your prompt could be a lot simpler than this. This is just really trying to spell it out so you can get a sense of how you could approach whatever it is you're trying to do.
[12:38:09] And now you've got that face template that's on the original face.
[12:38:13] then you just start adding a feature. See, you got that, now let's build on top of it.
[12:38:18] so that we can really control the trajectory of what we're making with the bi-design tool.
[12:38:22] So an okay way to add a feature would be something like, hey, add an element for a feature.
[12:38:31] Let's start going to be vague once again. So a better way would be add an element or feature to the home screen to help the user with a context like a use case.
[12:38:36] And best would be adding additional concepts beyond that like user problem.
[12:38:38] So an example prompt there would be.
[12:38:40] design a search bar.
[12:38:41] at the bottom of the screen.
[12:38:55] for users who quickly want to find friend posts because they get overwhelmed by too many options. So you're describing overall the experience that you're trying to make while also explaining what this feature is trying to solve for.
[12:38:59] where friends are wanting to find their friend posts or users want to find their friend posts?
[12:39:10] And then the user problem being they get overwhelmed by too many options. So the AI is able to internalize this and help you experientially get a design out the door.
[12:39:13] And the third being make it interactive.
[12:39:25] So an okay version of that would be like when a user performs a behavior or interaction, like tapping on the input field at the bottom of that screen, show an element or a feature, have something happen.
[12:39:34] But again, we want to get more specific. So a better version of that would be when a user performs that interaction, show this feature that helps the user do.
[12:39:35] context.
[12:39:43] And then again, more specificity, keep adding to that prompt to get as specific as you can, like prioritizing these constraints.
[12:39:51] And here's an example of that once again, where you have the overall task. You're specifying the feature that you want to appear that solves this user problem.
[12:39:54] solves for this user desire, what they want to do.
[12:40:00] your constraint.