Peter Cooper peterc

On Runpod with latest PyTorch image (2.4.0) with a GPU > 32GB VRAM (e.g. NVIDIA A100 80GB PCIe).

ssh in and:

apt update -y
apt install -y nano screen git
pip install git+https://github.com/huggingface/trl.git accelerate transformers datasets peft wandb tqdm ninja flash-attn

You are a 'thinking agent'. Instead of answering queries directly and quickly, you engage in a protracted period of thought in .. tags where you riff on how you might answer the query, what facts or context you need to take into account, and what would go into a good answer. Your answer will then follow, based upon the ideas that arose during your thinking. It is important that you query yourself and second guess your thinking in order to extract new thoughts, approaches, and engage in reflection to ensure you reach the best level of thinking for your eventual answer. Your thinking should read in the first person in the way that a person may think in terms of an internal monologue. For example, you might start by thinking 'Ok, so I need to...' and go through processes where you think like 'I guess that..' or 'Maybe I should..' in order to surface new ideas and considerations. If you are unsure about anything, do not guess or fabricate facts you are unsure of. You are allowed to be uncertain a

How to set up a basic Sinatra + React webapp in 2025

Let's say you want to use Ruby for the backend of a basic webapp but React on the frontend. Here's how.

(Note: All tested on January 13, 2025 with Ruby 3.3, Sinatra 4.1.1, and React 18.3. Configs may change over time.)

First, create the app folder and set up Sinatra:

mkdir my-sinatra-react-app

A test of the technique illustrated by Simon Willison at https://til.simonwillison.net/llms/docs-from-tests

JSON Library Usage Documentation

Basic Usage

Parsing JSON

# Parse JSON string into Ruby objects

To compile:

as -o hello.o hello.s
ld -o hello hello.o -lSystem -syslibroot `xcrun -sdk macosx --show-sdk-path` -e _main -arch arm64

./hello


	import Metal

	// Inline Metal shader code
	let shaderSource = """
	kernel void multiply(const device float* a [[ buffer(0) ]],
	const device float* b [[ buffer(1) ]],
	device float* result [[ buffer(2) ]],
	uint id [[ thread_position_in_grid ]]) {
	result[id] = a[id] * b[id];

	#!/bin/bash

	# Check if a repository URL was provided
	if [ $# -ne 1 ]; then
	echo "Usage: $0 <repository-url>"
	exit 1
	fi

	REPO_URL=$1

	WITH RECURSIVE
	xaxis(x) AS (
	SELECT -2.0
	UNION ALL
	SELECT x + 0.05 FROM xaxis WHERE x < 1.2
	),
	yaxis(y) AS (
	SELECT -1.0
	UNION ALL
	SELECT y + 0.1 FROM yaxis WHERE y < 1.0

	require 'http'
	require 'json'

	class GroqClient
	def initialize(api_key: nil, api_url: "https://api.groq.com/openai/v1/chat/completions", model: "mixtral-8x7b-32768")
	@api_key = api_key \|\| ENV['GROQ_API_KEY']
	@api_url = api_url
	@model = model
	end