Welcome to Scream Logbook

These are my notes from trying to make stuff work, sparse and mostly for myself.

I use MacOS with Apple Selicone, so notes are centered around that. btw. here is useful link on Silicon Macs.

Sentiment Analysis

Python libraries:

Textblob
Natural Language Toolkit (NLTK)
Don’t use pattern (no longer maintained)

from textblob import TextBlob

blob = TextBlob(text)

for sentence in blob.sentences:
    print(sentence.sentiment) # sentiment.polarity sentiment.subjectivity

Polarity: connotation +positive vs -negative (+happy vs -sad)
Subjectivity: +objective vs -subjective (+fact vs -opinion)

Web Requests and Scrapping

HTTP Status Codes

200 is success
404 is not found
1XX is information
2XX is success
3XX is redirect and other annoynaces
4XX and 5XX are failures

Curl

Curl.se

curl https://example.com

Python

import requests
r = requests.get('https://example.com/')
print(r.text) # HTML as string
print(r.status_code) # <int>

Beautiful Soup

Docs for Beautiful Soup 4

from bs4 import BeautifulSoup
soup = BeautifulSoup(html_doc, 'html.parser')

PHP

How to get a baisic php website running.

PHP is a Template language. It sort of has it’s own html tag. <?php [code] ?>

index.php

<!DOCTYPE html>
<html>
  <body>
    <h1>Current Time:</h1>
    <?php
        $current_time = date("h:i:sa");
        echo "<p>Current time is $current_time</p>";
    ?>
  </body>
</html>

If you run php index.php > output.html & open output.html you will get an html with the current time substituted.

<!DOCTYPE html>
<html>
  <body>
    <h1>Current Time:</h1>
    <p>Current time is 04:28:45pm</p>
  </body>
</html>

In fact, it doesn’t even need to be HTML.

Hello World at <?php
    $current_time = date("h:i:sa");
    echo "$current_time";
?>.

Compiles into Hello World at 04:38:02pm. just fine.

PHP just replaces it’s own code with the code’s output.

Server

A server that automatically compiles all requested php files is a builtin command.

php -S localhost:8000

SQLite

SQLite comes out of the box

<?php
$db = new SQLite3('sqlite3db.db');

$results = $db->query('select * from db');
while ($row = $results->fetchArray()) {
var_dump($row);
}
?>

Programming Tales

Talks and Lectures

How Debuggers Work by Sy Brand at GOTO 2025

List of Algorithms

List of Algorithms whose names I sometimes forget.

CORDIC method (aka higher/lower game)
- CORDIC for Dummies
- tricks
  - use lookup table or easy to compute steps
  - use convienient rathern than optimal step magnitudes
Power Iteration
Arithmetic coding
Reservoir sampling
Voronoi diagram
- Fortune’s algorithm
Diffie-Hellman (DH) Key Exchange
Shunting Yard Algorithm for parsing expressions

Python CLI Libraries and Notes

Argparse builtin
Click the classic python cli library
Typer minimalist and easy to add
Plumbum does some crazy unix stuff

Also Python Printing Libraries like [Rich]((./printing_in_python.md#rich) will be really relevant.

Git

Git Worktree

git worktree add <path> [<branch>]

warning, worktrees are not added to gitignore automatically, make sure to add them. echo ".worktree" >> .gitignore

.git
.gitignore
.worktrees
L tree1

so usually

mkdir .worktree
echo ".worktree" >> .gitignore
git worktree add .worktree/tree2 main

Multiple Git Identities / Profiles

Multiple Git Profiles Guide by Icaruk

Git Hooks

in .git/hooks are a bunch of .sample files (bash). If the .sample ending is removed the hook becomes active. (Literally just bash files.)

Add linter to .git/hooks/pre-commit

Git Ignore

For local (non-cloud sync stuff) put it into .git/info/exclude

README Style Guide

Template

link to repo somewhere at the top. Finding the source / remote origin is hard in cloned repositories.
links to related projects, preferably even before your own demo.

Art of README
Software Relsease Pracieces by The Linux Documentation Project
GNU Releases

Project Title

Github Repo | Website | Docs | License

Also check Shields.io and Github Special Files and Paths

Brief description.

Tooling: Python, etc. etc.

Similar projects: Awesome Readme

Dealing with Secrets

Never ever hardcode snsitive information, especially when publishing it. Put whatever holds the secrets into .gitignore.

TOC:

dotenv (Python)

Dotenv

L main.py
L .env

PASSWORD=password1234

import os # necessary
from dotenv import load_dotenv

load_dotenv('.env') # Loads into OS

password = os.getenv('PASSWORD') # Gets from the OS

(os.getenv("HOME") is Bash environmental variables $ env)

Android Termux

Default package manager is pkg

But it doesn’t work for 99% of stuff, so expect to compile and git clone stuff yourself. Also, superuser is broken unless you have rooted your phone.

SSH server

SSH = Secure Shell (encrypted connection to another computers commandline)

Official docs on Remote Access.

Doing everything from the computer is 10x easier, so use ssh.

In Termux

Install OpenSSH pkg install openssh
Host with sshd (opens on port 8022)
1. This exposes your device only on the local (WiFi) network.
2. Check your ip address in ifconfig. 127.0.0.1 is localhost, instead you want the 192.168.[...].[...] local address.
whoami should give current user (something like u0_a123)
Setup password with passwd (Remember step 1.1, so don’t set defaults)
Do whatever you wanted to do.

Last. pkill sshd to close

Hosting stuff

Only real usecase of using a phone for selfhosting, is when you don’t have your laptop, but other people for some reason do, and you want your phone to do the heavy lifting.

Figure out IP you will be hosting stuff from:

Localhost: 127.0.0.1 or localhost.
Local (home network): ifconfig (192.168.[...].[...])
Public:

Awesome Selfhosted

What I managed to get running:

Atheos Web IDE

Github

Normal install won't work because Termux doesn't like sudo.

Atheos is written in PHP. So

Hence git clone https://github.com/Atheos/Atheos

cd Atheos

php -S [your local ip]:8000 (local network php server on port 8000)

Open [phone's local ip]:8000 in your computer browser and enjoy.

JupyterLab Python Notebook

Github

Given how Termux doesn't like pip, and how JupyterLab + Kernels are generally hard to get working, messing with JupyterLab will likely be futile.

Try pip3 install jupyterlab at pray that it works.

VS Code

Github

You can do VS Code online at vscode.dev, only caviat, you need to pay Github for hosting, or provide your own server.

At this point, consider signing up for Replit or some other online IDE. But if you are really set on hosting from your phone: they conviniently have a tutorial on their official website. (tldr pkg install code-server)

No JupyterLab because pip breaks
No Marimo because pip breaks

Python

Yes, pip constantly fails to install stuff

Python

Awesome Python

Managing Data

8 June 2026

HDF5

official hdf5py docs

Plotting

Ax and Fig in Matplotlib

fig, ax = plt.subplots(figsize=(10, 3))

Printing in Python

list of tricks for advanced output to the terminal

Created July 28th 2025 for Python 3.13.0

Default Print

Color

Libraries

Pretty Print

import pprint as pp

Pretty Print Plus Plus

Just better Pretty Print, though less supported.

Github (400 stars, last update in 2020)

IceCream

Print for Debugging, automatically prints the variable being printed.

from icecream import ic
ic() # will print it's own filename and line number
ic(max(3.141,6.283)) # ic| max(3.141,6.283): 6.283

Github

Rich

Powerful library for working with text in the terminal.

Docs

from rich.pretty import pprint
pprint(locals())

pip install rich

SetPrint

Gmail with Python

Getting into Gmail with Python.

Use a testing account.

Simple way: (the way 3rd party clients like Thunderbird do it.)

SMTP (comms between servers) smtplib is builtin
POP3 (read only from email server) poplib is builtin
IMAP (read/write with email server) imaplib is builtin
- email python library/parser

Complex way: Gmail API with Google Cloud (good luck)

Warning: Don’t hardcode tokens and keys. (how to handle secrets)

Config:

List of Servers/Subdomains for Major Email Providers (imap.gmail.com)
username/email youremail@example.com
password: Special “App Password”
- You will need to click around in your account

IMAP

import os
from dotenv import load_dotenv
load_dotenv('.env')
username = os.getenv('USERNAME')
password = os.getenv('PASSWORD')

import imaplib

server = 'imap.gmail.com'
imap = imaplib.IMAP4_SSL(server)
imap.login(email, password)

print(imap.list()) # lists mailboxes
status, messages = imap.select(mailbox="INBOX",readonly=True)

Emails on the server are assinged sequential IDs. Starting from 1.

msg_uid = 10
status, msg = imap.fetch(str(msg_uid),'(RFC822)') # no clue why RFC822
# msg
#  0: msg itself
#  1: (uid, data)

import email
data = msg[1][1]
m = email.message_from_bytes(data)

print(m.get_payload())

Glossary

NOOP command (imap.noop()) is a test packet. Similar to a ping.

MIME is Multipurpose Internet Mail Extensions

Header Fields

['Delivered-To', 'Received', 'X-Received', 'ARC-Seal', 'ARC-Message-Signature', 'ARC-Authentication-Results', 'Return-Path', 'Received', 'Received-SPF', 'Authentication-Results', 'DKIM-Signature', 'X-Google-DKIM-Signature', 'X-Gm-Message-State', 'X-Google-Smtp-Source', 'MIME-Version', 'X-Received', 'Date', 'X-Account-Notification-Type', 'Feedback-ID', 'X-Notifications', 'X-Notifications-Bounce-Info', 'Message-ID', 'Subject', 'From', 'To', 'Content-Type']

Key	Description	Example
`Subject`	Subject line of the Email	“Shedule for Meeting”
`From`	Sender Email Address	sender-email@example.com
`To`	Recipient Email Address	recipient-email@example.com
`Date`	Date in Long Format with time zone	Sun, 19 Jan 2025 00:11:46 GMT
	More Obscure Fields
`Content-Type`	Media Type (Full List) boundary charset	`text/plain`
`Received`	by [IPv6] with [Protocol] id [alphanumberic]
`Delivered-To`	Recipient Email Address	recipient-email@example.com

Dealing with Multipart Emails

Content-Type: multipart/alternative, mutlipart/mixed, etc.

Multipart Emails contain multiple parts with different types. And many email providers/clients don’t bother minimizing the type, just always use the universal multipart.

.is_multipart()

Iterator: Warning! first object is parent itself!

.walk() generator object to iteratre through all message parts.

“part” object:

.get_content_type() (get subtype)
.is_multipart() (can be nested)

Attachments

Actions

FLAGS:

Marking Read/Unread

Flask (Python)

flask official docs

installation

flask --app scriptfile.py run

from flask import Flask, render_template, jsonify

app = Flask(__name__)

@app.route('/hello/<path:subpath>', methods=['GET', 'POST'])
def hello_world(subpath):
    return f"<p>Hello, World! {subpath}</p>"
    
@app.route('/template/')
@app.route('/template/<name>')
def hello(name=None):
    request_data = request.get_json(silent=True)
    return render_template('hello.html', person=name)

@app.rout('/json')
def json():
    dict = {"a": 0}
    return jsonify(dict)

Python GUI Libraries

DearPyGui

Docs

Starter snippet

import dearpygui.dearpygui as dpg

dpg.create_context()

with dpg.window(tag="Primary Window"):
    dpg.add_text("Hello, world")

dpg.create_viewport(title='Custom Title', width=600, height=200)
dpg.setup_dearpygui()
dpg.show_viewport()
dpg.set_primary_window("Primary Window", True)
dpg.start_dearpygui()
dpg.destroy_context()

Python Android

Official Python docs page concerning Android

Buildozer / Kivy

Buildozer

For some reason cli does not show up on MacOS.

Briefcase / BeeWare

Briefcase Docs

Basically the Toga GUI Framework.

The Android Ecosystem is a nightmare, building the app took ages of downloading emulators and what not.

ChaquoPy

Basically an ugly Java Wrapper.

pyQtDeploy

site

Last updated 2022.

Document Operations

Working with common file formats in Python

Epub in Python

Written in October 2025

General Apps: (for inspecting and verifying)

Sigil Ebook Editor

Libraries:

ebooklib (basic r/w) currently under rewrite, so docs are horrible.

PDF in Python

Libraries:

fpdf2 for creating PDFs

fpdf2

Docs

from fpdf import FPDF

pdf = FPDF()
pdf.add_page()
pdf.set_font("helvetica", style="B", size=16)
pdf.cell(40, 10, "Hello World!")
pdf.output("tuto1.pdf")

Quarto

Website

Document title:

---
title: My Notebook
author: My Name
date: 2026-02-08
format:
  html:
    code-fold: true
    code-summary: "Show the code"
  pdf:
    code-overflow: wrap
    echo: false
    output: true
---

Machine Learning

Torch

Skeleton

Dataloader:

class MyDataset(Dataset):
    def __init__(self):
    def __len__(self):
        return 
    def __getitem__(self, idx):
        return X, y

train_ds = MyDataset(TRAIN_PATH)
test_ds = MyDataset(TEST_PATH)

train_loader = DataLoader(
    dataset=train_ds,        
    batch_size=10,          
    shuffle=True,
)

test_loader = DataLoader(
    dataset=test_ds,        
    batch_size=10,           
    shuffle=True,           
)

training code:

model = nn.Sequential(
    nn.Linear(len(input), 500),
    nn.ReLU(),
    nn.Linear(500, len(output))
)

optimizer = torch.optim.Adam(model.parameters(), lr=0.001)
criterion = torch.nn.MSELoss() 

epochs = 100
for epoch in range(epochs):
    model.train()
    for batch_idx, (data, target) in enumerate(train_loader):
        output = model(data)
        loss = criterion(output, target)
        optimizer.zero_grad()
        loss.backward()
        optimizer.step()
    print(f"Epoch {epoch} complete. Loss: {loss.item():.4f}")

validation

model.eval()
val_loss = 0
correct = 0
with torch.no_grad():
    for data, target in test_loader:
        output = model(data)
        val_loss += criterion(output, target).item()
avg_loss = val_loss / len(test_loader)
print("Validation loss", avg_loss)

alternatively, validation oneliner

model.eval()
with torch.no_grad():
    # Calculate all batch losses in a single line
    avg_loss = torch.tensor([criterion(model(x), y).item() for x, y in test_loader]).mean().item()
print(f"Validation loss: {avg_loss}")

wandb

pip install wandb

wandb login

import wandb
wandb.login()  # or will use the `wandb login` supplied account

wandb.init(
    entity="your-username-or-workspace-name",
    project="my-experiments"
)

wandb.log({
    "epoch": epoch,
    "loss": loss,
    "accuracy": accuracy,
})

For Hydra Integration

@hydra.main(version_base=None, config_path="conf", config_name="config")
def main(cfg: DictConfig):
    wandb.init(
        # entity=cfg.wandb.entity,
        project=cfg.wandb.project
    )

wandb:
  project: "test"

my Hydra notes

Hydra

pypi package name is hydra-core

Hydra Offical Docs

Boilerplate

import hydra
import logging  # logging will be auto set up
from omegaconf import DictConfig, OmegaConf

@hydra.main(version_base=None, config_path="conf", config_name="config")
def my_app(cfg : DictConfig) -> None:
    print(OmegaConf.to_yaml(cfg))

if __name__ == "__main__":
    my_app()

Turn off dir switching (and other stuff) from stack overflow:

# Source - https://stackoverflow.com/a/70777327
# Posted by J smit
# Retrieved 2026-05-20, License - CC BY-SA 4.0

defaults:  
  - _self_  
  - override hydra/hydra_logging: disabled  
  - override hydra/job_logging: disabled  
  
hydra:  
  output_subdir: null  
  run:  
    dir: .

Linters

https://github.com/psf/black

Logging

logging.basicConfig(
    level=logging.INFO,
    format="%(levelname)s: %(message)s",
    handlers=[
            logging.FileHandler('app.log'),
            logging.StreamHandler(),
        ]
)
logger = logging.getLogger(__name__)

Manim

Reender Qualities and Resolutions, also see Wikipedia

Command	Quality
`-ql`	854x480 15FPS (FWVGA)
`-qm`	1280x720 30FPS (HD)
`-qh`	1920x1080 60FPS (FHD)
`-qp`	2560x1440 60FPS (QHD)
`-qk`	3840x2160 60FPS (4K UHD)

Generally use the HD and FHD qualities, as QHD and 4K don’t work an all devices.

Custom resolution: -r 500,500

Warning, the scale of the cordinate system is different from the reendering resolution. It is attached to be proportional to the resolution width. This is set by config.frame_width=10

Useful:

-s saves only the last frame of the animation

Adding Objects

Creation / Introduction Animations

Mamba

mamba env list

mamba create -n <envname>

Common Python Libs

scipy
numpy
sklearn
matplotlib
polars
torch

Relative and other Imports in Python

Basic block for importing from elsewhere in github directories.

import sys
from pathlib import Path

github_root = Path.cwd().resolve().parents[2]
sys.path.append(str(github_root))

BS4 (Scraping)

soup = bs4.BeautifulSoup(html_doc, "html.parser")

for longer parses:

try:
    bs4.BeautifulSoup("<div>Test</div>", features="lxml")
    bs4_prefered_parser = "lxml"
except bs4.FeatureNotFound:
    bs4_prefered_parser = "html.parser"

Compiling C Projects

Read the damn docs and compilation instructions if available.

Classic

Classic way of compiling almost any project written in C.

./configure && make && make install

Breakdown:

./configure executes configure file to check dependencies

! Note that configure often doesn’t exist initially, and a autogen.sh (or similar) must be run (bash autogen.sh) to generate configure and other setup stup steps.

make

make install

Docs

Instructions for compiling/building/running are usually in README.md, INSTALLING.md, or a similar file. cat to read them.

The docs for small projects are usually outdated, files might have been moved around within the source code.

Use tree command to see what files there are.

Search for mentioned files in the source code via fuzzy finder fzf or find . -name "autogen*" (find command options starting/path Regex)

C Libraries

pkg-config --list-all to see all libraries you have installed.

If you need to install a library, you can compile it yourself using pretty much the same steps here.

LittleJS

LittleJS Github Repository

curl https://raw.githubusercontent.com/KilledByAPixel/LittleJS/refs/heads/main/dist/littlejs.js > littlejs.js

<!DOCTYPE html><head>
<title>LittleJS Hello World Demo</title>
<meta charset=utf-8>
</head><body>

<script src=littlejs.js></script>
<script src=game.js></script>

curl https://raw.githubusercontent.com/KilledByAPixel/LittleJS/refs/heads/main/examples/empty/game.js > game.js

js13k build and build.js

Download the build.js script from the LittleJS repo, and chmod +x build.js to give it execution permissions. (Or just run it with node)

build.js won’t work out of the box, go in and edit the variables at the top.

Issues:

Some npx <tool> fails to run. Look it up on npmjs.com and install globally via npm. eg. I had issues with Uglify JS.
If the game.zip is not appearing, chech if ect (efficient compression tool) is installed (which ect). see my notes on compiling ect

Lynx Browser

Famously cool browser, confusingly difficult to run.

Official Lynx Website has the latest stable version listed, as of writing it is 2.9.2.

Installing

Package Manager

Lynx is fairly popular, so most package managers have a lynx package. (see here)

You can check the version with lynx --version

Compiling it yourself

w3m

w3m is a CLI web browser written by a Japanese guy.

It is hosted on SouceForge.

Like most other C project, run ./configure && make && make install in the soure code directory.

Elinks

https://github.com/rkd77/elinks download latest release from releases (as of writing v0.18.0)

./configure && make && make install

you might notice ./configure doesn’t work

Run ./autogen.sh and it configure will appear.

.configure should produce a list of features that will and won’t work based on prerequisite libraries. (Even if some are missing, that should be ok.)

make should compile and list bunch of linking (LD and CC) for the above libraries.

make install should put the final binary into your bin folder.

elinks should work now

Installing Libraries

“tre” Regex Library

Browsh

Browsh Offical Website and Browsh Github repository, also Browsh

As of writting, browsh is version 1.8.3. (browsh --version)

Browsh is actually fairly well documented. See SETUP_DEV_[Platform].md for compilation instructions.x

To Quit Browsh: Ctrl+Q

Context on innerworkings: Browsh has Firefox running in the background, and mirrors it into ANSI text on the terminal. It thus requires Firefox installed, and relies on it. In fact, you can view the mirrored instance using browsh --firefox.with-gui.

OPTical ARchiver (optar)

If you are building optar yourself, download from github (git clone https://github.com/colindean/optar)

Outdated Website

Dependencies

Libpng (see compiling libpng)
ImageMagick

Compiling

make will compile everything

make install (sudo make install if necessary) will install optar, uoptar, and pgm2ps into bin. (/usr/local/bin) you can check that with which [command].

pgm2ps

pgm2ps is actually a shell script. You can open it in a plaintext editor and edit it.

Run which pgm2ps, and edit it using any editor. (eg. vi $(which pgm2ps))

solve outdated imagemagic warning (see below)
change from A4 to US Letter formats (see below)

Writing (Encoding)

optar <input file> [filename base] (filename base is basically output file name without an extension)

This will roduce a filename-base.pgm file. PGM is a “grayscale image format”.

Converting pgm2ps Stage

pgm2ps <file.pgm> or pgm2ps *.pgm to convert ALL .pgm files in the directory into printable PostScript (.ps).

If there is a warning about magick and covert. Run which pgm2ps, (pgm2ps is just a shell script) and vi <path>. Then replace covert command with magick.

A4 and US Letter changes

If you want to change to A4 (default) or US Letter, you have to edit which pgm2ps file. Substitute the following equations as described in comments within pgm2ps:

US Letter: 573.84x755.28+19.08+18.36
A4: 556.56x807.12+19.22+17.44

PostScript (.ps) is the file format printers use for printing. Gimp can open .ps and .pgm file formats, for checking if they are ok.

Reading (Decoding)

Just check the docs

You will need an industrial grade scanner for this.

unoptar <format-specs> filename-base > outputfile

Dragon

https://github.com/mwh/dragon

How to run the dragon cli tool for drag and dropping files.

Dependencies: GTK+ 3, X11 or Wayland

You are required to build it yourself, no binaries are available. Also development seems to have halted with v1.2.0 in 2022. These instructions are for MacOS.

The official README has great installation instructions.

To start, cd into some folder you don’t mind having a bit of junk files in. eg. cd ~/Downloads

git clone https://github.com/mwh/dragon.git
cd dragon to enter the folder with the sourcecode
make will use the Makefile file to compile dragon binary.
1. Dealing with dependecy issues. Dragon requries GTK+ 3. For MacOS brew install gtk+3
2. You might need to install X or X11 window manager. Just google how to install it.
make install to but the dragon binary into the bin folder.
dragon will run dragon and print Usage: dragon [OPTIONS] FILENAME
dragon example will create a window with a drag-and-droppable folder from the example folder in the source code directory. (ls)

Random Libraries

Tre Regex Library

https://github.com/laurikari/tre

git clone https://github.com/laurikari/tre

./utils/autogen.sh (creates configure executeable among other things)

./configure
make
make check
make install

Libpng

Download source

Warning, the configure and other files have carriage retrun \r characters. You need to remove them, because sh hates them.

To remove carriage returns

sed -i.bak 's/\r$//g' <filename>

sed -i.bak 's/\r$//g' configure

./configure
make check
make install

Efficient Compression Tool

Repo: Efficient Compression Tool

Created Sat Sep 13 15:38:28 EDT 2025, as of right now last ect update was in 2023.

ect cmake configs are outdated. Usecmake ../src -DCMAKE_POLICY_VERSION_MINIMUM=3.5.

then make and make install as per README instructions.

If you get issue about fp.h in pngpriv.h. Replace the include <fp.h> with include <math.h> (inside /src/libpng/pngpriv.h)

Build steps are pretty self explanatory with cmake and Xcode.

install cmake with brew
Xcode on mac is a known pain, Google everything

Data Hoarding

Currently still can’t get it to work.

grab-site website archiver

Github repo by Archive Team

Installation on Apple Silicon

(on August 2025 for MacOS 15.6 with Python 3.13.0 and grab-site 2.2.7) brew update update homebrew brew install libxslt re2 pkg-config install libraries via homebrew

libxslt is for XML parsing
re2 is a regex library
pkg-config is for compiling libraries (not sure) python3 -m venv ~/gs-venv create python virtual environment, and puts its config at ~/gs-venv PKG_CONFIG_PATH="/usr/local/opt/libxml2/lib/pkgconfig" make sure pkg-config works before the next step ~/gs-venv/bin/pip3 install lxml install lxml library into virtual environment ~/gs-venv/bin/pip3 install git+https://github.com/ArchiveTeam/grab-site install grab-site from github into the virtual environment. If it fails to compile due to cchardet being deprecated.

Add PATH="$PATH:$HOME/gs-venv/bin" to ~/.zshrc (or equivalent). Then restart terminal or source .zshrc.

Usage

gs-server and see menu at http://127.0.0.1:29000/ (localhost)

grab-site 'URL'

Windows Operating System

Entering boot menu:

Shift + Restart
Troubleshooting
Advanced options
Start
Fn + F12

Windows 11 Debloat

Windows 10 Debloat

C++

Resources

File IO in C++

#include <cstdio>
#include <iostream>
#include <fstream>
#include <string>
using namespace std;

void fileFunction(const std::string& filename)
{
    std::string line;
    std::ifstream fh(filename);
    if (fh.is_open()) {
        while (std::getline(fh, line)) {
            std::cout << line << std::endl;
        }
    } else {
        std::cout << "Unable to open file" << std::endl;
    }
    fh.close();
    std::cout << "File Closed" << std::endl;
}

int main(int argc, char** argv) {
  fileFunction("file.txt");
  return 0;
}

Javascript

Vue

Component template

<script setup>
</script>

<template>
    <p>Hello, World!</p>
</template>

<script scoped></script>

Canvas API

const canvas = document.getElementById("canvas");
const ctx = canvas.getContext("2d");

ctx.fillStyle = "green";
ctx.fillRect(0, 0, canvas.width, canvas.height);

ImageData

MDN Docs on ImageData

let data = ctx.getImageData(x,y,w,h);
data = data.forEach((element,index,array)=>((index)%4==0? 255 : element));
ctx.putImageData(data,x,y);

Creating ImageData

let len = width * height * 4;
let data = new Uint8ClampedArray(len);
for (let i = 0; i < len; i+=4) {
  let color = Math.random() < (0.5) ? 255 : 0;
  data[i+0] = color;
  data[i+1] = color;
  data[i+2] = color;
}
return new ImageData(data,width,height);

qrcode.js

Last update 10 years ago.

Website

Unofficial CDN:

CDNJS:
- Full <script src="https://cdnjs.cloudflare.com/ajax/libs/qrcodejs/1.0.0/qrcode.js" integrity="sha512-is1ls2rgwpFZyixqKFEExPHVUUL+pPkBEPw47s/6NDQ4n1m6T/ySeDW3p54jp45z2EJ0RSOgilqee1WhtelXfA==" crossorigin="anonymous" referrerpolicy="no-referrer"></script>
- Min <script src="https://cdnjs.cloudflare.com/ajax/libs/qrcodejs/1.0.0/qrcode.min.js" integrity="sha512-CNgIRecGo7nphbeZ04Sc13ka07paqdeTu0WR1IM4kNcpmBAUSHSQX0FslNhTDadL4O5SAGapGt4FodqL8My0mA==" crossorigin="anonymous" referrerpolicy="no-referrer"></script>

Pixi.js

Pixi.js is not a “game engine” but a “reendering engine” consequently it doesn’t have basic features like collision detection.

Github

Mouse Events:

app.stage.eventMode = "static";
app.stage.hitArea = app.screen;
app.stage.on('pointermove', event => {
    console.log(event.global.x, event.global.y)
});

Ticker

app.ticker.add((delta) => {
  let fraction_of_second = delta.deltaTime;
});

JS Math Tricks

Integer Division

let result = ~~(a/b); // double NOT operator forces int casting

Extension Setup

Tooling

Editor with standard JS highlighting
web-ext cli tool for making Web Extensions (official by mozilla)
- brew install web-ext
about:debugging#/runtime/this-firefox for debugging background.js

Resources

Web-ext Running

web-ext run opens a test browser. Press R to reloat the test browser.

Anatomy

extension
L icons
  L icon.png
L manifest.json
L background.js // runs on the browser level
L content.js // runs inside the tab, is injected into website's html
L popup
  L index.html // <script src="popup.js"></script>
  L popup.js

Common APIs

Communication Between Scripts

Communication with content script requires Query. Background to Popup can do normal Messages. (Because there is one background and popup, but content.js in each tab).

Relay Code

// background.js
browser.runtime.onMessage.addListener((message, sender) => {
  if (message.to === "popup") {
    // Send to popup
    browser.runtime.sendMessage({ from: "content", data: message.data });
  }

  if (message.to === "content") {
    // Forward to active tab’s content script
    return browser.tabs.query({ active: true, currentWindow: true })
      .then(tabs => {
        if (tabs[0]) {
          browser.tabs.sendMessage(tabs[0].id, { from: "popup", data: message.data });
        }
      });
  }
});

// content.js
browser.runtime.sendMessage({ to: "popup", data: "Hello from content script!" }); // the to: "popup" is read by background for forwarding

browser.runtime.onMessage.addListener((message) => {
  if (message.from === "popup") {
    console.log("Content got:", message.data);
  }
});

// popup.js
document.getElementById("send").addEventListener("click", () => {
  browser.runtime.sendMessage({ to: "content", data: "Hello from popup!" });
});

// Listen for content messages
browser.runtime.onMessage.addListener((message) => {
  if (message.from === "content") {
    console.log("Popup got:", message.data);
    document.getElementById("log").textContent = "Popup got: " + message.data;
  }
});

Query Code

// popup.js
async function askContent() {
  let [tab] = await browser.tabs.query({ active: true, currentWindow: true });
  let response = await browser.tabs.sendMessage(tab.id, { type: "GET_INFO" });
  console.log("Got from content:", response);
}

askContent();

// content.js
browser.runtime.onMessage.addListener((message, sender, sendResponse) => {
  if (message.type === "GET_INFO") {
    sendResponse("Here is the info from content script");
  }
});

Downloading

downloads.download() MDN docs. Also supports saving to within a folder

let downloading = browser.downloads.download({
  url: downloadUrl,
  // or body: "text goes here",
  filename: "Subfolder/file.txt",
  conflictAction: "uniquify",
});
// downloading can then be used for error handling, see docs

For devtools, open about:debugging#/runtime/this-firefox > Inspect

Popup MDN docs

Page Action

Page action (and Address bar button) are tab specific. ~~The code for them is written in popup.js (browser-action script).~~ idk yet where it goes.

The main methods are

setPopup to specific html file to use
onClicked
browser.pageAction.show(tabId) and browser.pageAction.hide(tabId) to get tabId use browser.tabs.query({ active: true, currentWindow: true })[0].id

ThreeJS

Docs:

Excalibur.js

Website

Scrapping With JavaScript

DOM Parser creates a document from plaintext html.

Grabbing the entire HTML document with JS - Stackoverflow

'<!DOCTYPE HTML>' + '\n' + document.documentElement.outerHTML
new XMLSerializer().serializeToString(document)

new URL("https://example.org/")

Querries

document.querySelectorAll("h1, h2, h3, h4, h5, h6");

Abstract Objects

Getting position on page Stackoverflow MDN Docs getBoundingClientRect

// relative to viewport
var rect = element.getBoundingClientRect(); // read only
console.log(rect.top, rect.right, rect.bottom, rect.left);
// adjust for scroll
rect.left+window.scrollX;
rect.top+window.scrollY
// for reference
window.screen.width;
window.screen.height

W3

HTML Boilerplate

Sources:

HTMLBoilerplates.com

<!DOCTYPE html>
<html lang="en">
    <head>
        <meta charset="UTF-8" />
        <title>Template Title</title>
        <meta name="viewport" content="width=device-width,initial-scale=1" />
        <meta name="description" content="Description Goes Here" />
        <link rel="stylesheet" type="text/css" href="style.css" />
    </head>
    <body>
        <h1>Template</h1>
        <script src="index.js"></script>
    </body>
</html>

Fullscreen

// On pressing ENTER call toggleFullScreen method
document.addEventListener("keydown", (e) => {
  if (e.key === "Enter") {
    toggleFullScreen(element);
  }
});
function toggleFullScreen(element) {
  if (!document.fullscreenElement) {
    // If the document is not in full screen mode
    // make the video full screen
    element.requestFullscreen();
  } else {
    // Otherwise exit the full screen
    document.exitFullscreen?.();
  }
}

Canvas API

Page Quality Checkers

w3c validator “nu”

Markdown

Awesome Markdown

Markdown To HTML

Fake Latex For Assignments

Courses demand I use LaTeX, but I want to use markdown, so I will make fake LaTeX.

Workflow:

write markdown in normal editor -> convert to HTML via pandoc -> Style HTML using a lookalike stylesheet -> covert html to pdf (by printing in browser) -> submit

Note: Pandoc can also do direct MD -> LaTeX coversions

I will use Latex.vercel.app style sheet. <link rel="stylesheet" href="https://unpkg.com/latex.css/style.min.css" />

Final pandoc command: pandoc --mathml -o=output.html --template=template.html input.md See template.html below

Relevant Docs:

Pandoc templates
- standalone -s, --standalone
- see defualt template pandoc -D html
- --template=file.html
break-after: page
- MDN docs for <hr> tag
- Markdown --- line is converted into <hr>
- hr {break-after: page} allows to split pages of the pdf
MathJax converter <script id="MathJax-script" async src="https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-mml-chtml.js"></script>
Pandoc Math reendering in HTML (tldr use --mathml)

template.html

<!DOCTYPE html>
<html lang="en">
    <head>
        <meta charset="UTF-8" />
        <title>Fake Latex Assignment</title>
        <meta name="viewport" content="width=device-width,initial-scale=1" />
        <meta name="description" content="Description Goes Here" />
        <link rel="stylesheet" href="https://unpkg.com/latex.css/style.min.css" />
        <style>
            hr {
                break-after: page;
                visibility: hidden;
            }
        </style>
    </head>
    <body>
        $body$
    </body>
</html>

Markdown To Presentation

pandoc -t FORMAT --standalone habits.txt -o habits.html

where FORMAT is either s5, slidy, slideous, dzslides, or revealjs.

https://pandoc.org/MANUAL.html#slide-shows

Pandoc can convert markdown into revealjs and other formats.

Pandoc markup:

% Title
% Firstname Lastname
% Month Day, Year

# Slide 1

## Subslide 1

slide 2

## Subslide 1
- bullets
- bullet

------------------

# Slide 2
![Lorem Picsum](https://picsum.photos)

List of presentation tips:

make it easy to setup and reset
avoid overusing words
people can look either you or the slides at a time
big font
QR codes
top talking speed is 3 words per second
top comprehension is 1 fact / second

Rust

Rust Iced Library

Rust Iced GUI Library

Official Github Repo

Guides:

Basic Widgets

#![allow(unused)]
fn main() {
button("Button").on_press(Message::ButtonPressed)
}

Layout

The layout is a bunch of nested lists, they way you expect:

#![allow(unused)]
fn main() {
container() // takes one element
column![]
row![]
}

Compiling with Cargo

Crazy Target File sizes

Cargo target directories are 1GB+ in size for basic projects

To decrease size:

C

Boilerplate

#include <stdio.h>
int main(int argc, char *argv[]) {
    printf("Hello, World!\n");
}

Compiling Libraries

Create static library

write foo.c and foo.h

// foo.h
#ifndef FOO_H
#define FOO_H
int add(int a, int b); // just the headers
int multiply(int a, int b);
#endif

gcc -c foo.c -o foo.o

-c means compile an object.

ar rcs libfoo.a foo.o

r (replace)
c (create archive if it doesn’t exist)
s (index to speed things up)

use static library

gcc myscript.c -L. -lfoo -o myscript.a

the -lfoo automatically looks for libfoo with prefix.

Simple Directmedia Layer

Libsdl.org website

Compiling

gcc -std=c89 -Wextra -pedantic-errors -o main.out main.c -lSDL2 ./main.out

Examples

Drawing colored pixels:

//  https://stackoverflow.com/questions/20579658/how-to-draw-pixels-in-sdl-2-0
#include <stdlib.h>

#include <SDL2/SDL.h>

#define WINDOW_WIDTH 600

int main(void) {
    SDL_Event event;
    SDL_Renderer *renderer;
    SDL_Window *window;
    int i;

    SDL_Init(SDL_INIT_VIDEO);
    SDL_CreateWindowAndRenderer(WINDOW_WIDTH, WINDOW_WIDTH, 0, &window, &renderer);
    SDL_SetRenderDrawColor(renderer, 0, 0, 0, 0);
    SDL_RenderClear(renderer);
    SDL_SetRenderDrawColor(renderer, 255, 0, 0, 255);
    for (i = 0; i < WINDOW_WIDTH; ++i)
        SDL_RenderDrawPoint(renderer, i, i);
    SDL_RenderPresent(renderer);
    while (1) {
        if (SDL_PollEvent(&event) && event.type == SDL_QUIT)
            break;
    }
    SDL_DestroyRenderer(renderer);
    SDL_DestroyWindow(window);
    SDL_Quit();
    return EXIT_SUCCESS;
}

Reading Images:

https://gamedev.stackexchange.com/questions/131138/how-to-pass-png-image-data-directly-to-sdl

IO

Quickref.me File Processing Entry

LaTeX

aka Tex, MathJax

Ctrl+F to search. pdflatex file.tex to compile

Symbol lookup:

Detexify (for symbols)
QuickRef.ME (for general math)
MathJax Basic Tutorial and Quick Reference

Front Matters

% metadata
\documentclass{article}
\title{Test}
\author{Me}
\date{\today}
% displayed
\begin{document}
\maketitle
\end{document}

documentclasses Stackexchange Discussion, main classes article, proc, minimal, report, book, slides, memoir, letter, beamer

Basic Math

Resources

Not So Short Introduction to LaTeX

working with File System in Python

Main libraries:

import os (os docs)
import pathlib (pathlib docs)

Setup

For pathlib operations of file system, Path("the/path/string.txt")
For pathlib operations of file path use PurePath("the/path/string.txt")

Managing Files

Listing files:

from os import listdir
path = "."
print(listdir(path))

R/W on known paths

Check if stuff even exists

os.path.exists(file_path_os) (check if path exists)
os.path.isfile(file_path_os) check if thing is a file (not dir)
Path.exists()
- Path.mkdir(parents=True)

Parsing

os.path.split()
path = pathlib.PurePath("path/goes/here.txt") Pathlib accessing individual components
- PurePath.anchor (root baisically)
- PurePath.name -> filename.txt
- PurePath.suffix -> .txt
- PurePath.stem -> filename without suffix
- PurePath.with_suffix(".csv") to (replace) add file extension

Shebang

#! /usr/bin/env python3

chmod +x script.sh

Ruby

written June 2025 on MacOS 15.5

~~brew install ruby~~

MacOS has version 2.6 ruby preinstalled (which is outdated, current>3.0). There is nothing you can do about this.

The brew installation won’t work, because the 2.6 binary takes priority over the 3.0, so nothing will work out of the box.

Stackoverflow thread on this issue

Check paths with type -a ruby or which -a ruby

Check versions with ruby --version, gem --version

Which is why you need Ruby Environment Manager:

Ruby Environment Manager

rbenv

brew install rbenv ruby-build

rbenv install -l

rbenv install <version>

just follow Stackoverflow thread on this issue, it’s to confusing and complicated to explain what is acutally going on.

RubyGems

RubyGems.org Website

The gem package manager comes preinstalled with ruby.

gem update --system to update gem

ERROR:  While executing gem ... (Gem::FilePermissionError)
    You don't have write permissions for the /Library/Ruby/Gems/2.6.0 directory.

MacOS is defaulting to outdated 2.6 ruby. See above.

Profiling .zshrc

If your terminal takes a long time to show the first prompt, it is because sourcing your .zshrc is slow.

.zshrc is a shell script that runs every time you open a new terminal. It is a hidden file in the home folder: ~/.zshrc It is used by package managers and other shell tools to configure themselves before hand. Consequently, you will see a lot of conda, nvm, etc. in there.

Run source is the equivalent of import. So source ~/.zshrc will re-load your shell.

Trivia: The “rc” stands for “RUNCOM” according to wikipedia Wikipedia. Other shells like bash also have .bashrc files.

How to Profile

Time stamped echos:

echo "Start $(date +%s%N)ns" # nanoseconds, 9 places after the second
# ... suspects go here ...
echo "end   $(date +%s%N)ns"

time [utility] is usefull for timing the execution time of a single function. time sh test.sh with a suspect line in test.sh will print the execution time.

To print a nice table with breakdown of time consuming functions use (scroll to the top of the output):

zmodload zsh/zprof
# zshrc here
zprof

Warning: zprof is wierd and actually adds up the number of calls if you run source ~/.zshrc again in the same terminal session.

Comment out the thing that is taking up time, and see how fast the startup is. Then decide whether to remove it or speed it up or keep it.

# source $ZSH/oh-my-zsh.sh # 90% of my time

What to look for

source means a whole additional script is being run, which could have plenty of time consuming stuff hidden inside. Btw. . is an alias for source so if you see a . "script.sh", make sure to go after it.

Package managers. Whereever there is a package manager, there will be source and other time consuming stuff.

Install lazy loading plugin from here. It uses lazy loading (loads only once needed.)
conda initialization is infamously slow. See this reddit comment for a lazy loader
nvm is a common suspect. Google how to lazy load it as well.

Terminal customizers, such as oh-my-zsh. They are the main consumers of loading time, and and supposed to be. Look into tweaking them or using a different one if they are to slow. Google possible solutions here is one for oh-my-zsh.

From the Profiler output

Look at the top 10 lines of the zprof output.

compdump and compinit and compaudit are shell completions (when you press tab and it show you available commands). They are the the heaviest suspect. They run only once, and remove them if possible. I have found them being run multiple times on multiple occasions.

Open the .zshrc file in a text editor and Ctrl+F for compinit and just the word completions. Even if compinit is not in the file, package managers often attach comments.
Not all completions are guilty. For example [ -s "/Users/me/.bun/_bun" ] && source "/Users/me/.bun/_bun" (bun’s completion) doesn’t call compinit and is very fast when measured with time or echo "$(date +%s%N)"

What Not to Look For

export is fast. Unlike source, export doesn’t execute anything.

Powerlevel10k is famously fast.

More Resources

https://www.mikekasberg.com/blog/2025/05/29/optimizing-zsh-init-with-zprof.html
https://github.com/romkatv/zsh-bench?tab=readme-ov-file#summary
https://www.dribin.org/dave/blog/archives/2024/01/01/zsh-performance/
https://kasad.com/blog/zsh-profiling/
https://alextheobold.com/posts/profiling_zsh/

Diagnosing

How much file sizes should take up

Fonts: aggregated data:

85kib

Linux Network Diagnosing

iwconfig

wlan0 is WiFi
eth0 is ethernet (cable)
lo is localhost (I think)

lspci

lspci -nnk | grep -iA3 net (shows wifi chipset)

lsusb

ifconfig

ethtool is deprecated (gives error), use nmcli

nmcli device wifi list
nmcli device show
nmcli device status

inxi -Fxx (general device information)

speedtest by Ookla (cli version, needs installation)

Then start punching keywords into Google.

VMs

Docker

docker build -t <image_name> .
docker run --name <container_name> <image_name>

Tempalte

# Stage 1: Build stage (optional - for multi-stage builds)
FROM alpine
# other common FROM sources (technically any image would work):
# alpine, ubuntu, base, python:slim, https://hub.docker.com/search?badges=official

WORKDIR /app  
# docker RUN cd doesn't actually switch dirs, use WORKDIR instead

# Copy source code
COPY . .  
# everything except .dockerignore

RUN make

# which ports to expose
EXPOSE 3000
# but then the ports need to be mapped.
# docker run -p 3000:3000 myapp     # Manual mapping
# docker run -P myapp  # automap if possible
USER serverrunner
# switch to non root user for security

ENTRYPOINT ["echo", "Hello"]
CMD ["echo", "Hello"]

Ignore file (necessary)

# .dockerignore
#! .gitignore
# include gitignore
# Dependencies (reinstalled inside container anyway)
node_modules
npm-debug.log

# Environment files
.env
.env.local

# Git
.git
.gitignore

# Docker files
Dockerfile
.dockerignore

# IDE files
.vscode
.idea

# OS files
.DS_Store
Thumbs.db

# Logs
*.log
logs/

# Build outputs
dist/
build/

Virtual Machines on Apple Silicon

https://github.com/mikeroyal/Apple-Silicon-Guide#Linux-Virtualization-on-Apple-Silicon

https://www.reddit.com/r/debian/comments/11jkkrk/running_debian_on_apple_silicon/

Test Files

List of test files in different formats:

Related repositories:

Images:

Kodak color images
Lenna (use discouraged due to backstory) here is an alternative
Signal and Image Processing Database
my test images
- Items on Table

Audio:

Tom’s Diner was used for mp3 development, but is not public.
Bushwick Tarantella

Text:

Lorem Ipsum
Moby Dick
Big List of Naughty Strings

Data:

Datasaurus dozen

3D:

Sources:

Reddit post on Copyright Free Music

Scalable Vector Graphics

Tips for Writing SVGs by Hand

Editors:

https://www.svgviewer.dev/

When entering points for paths and shapes, use stroke="red" fill="blue" opacity="0.5" then switch to intended colors.

404

I probably changed the url sheme…

Use the search at the top to find whatever it was.

Browser Automation

Playwright

Playwright Website

Puppeteer

Puppeteer Website

Doing part of the work Manually

How to use Puppeteer in conjunction with manual, human activity? on r/node

/* automated stuff */

// do your manual work here
await page.waitForElement('.trigger-element',{ timeout: 100_000 })) // a selector that only appears after your manual work is done

/* continue automated stuff */

You can trigger continuation with.

let element = document.createElement("div");
element.className = "trigger-element";
element.style.display = "none";
document.body.appendChild(element);

((s)=>{
let element = document.createElement("div");
element.className = s;
element.style.display = "none";
document.body.appendChild(element);
})("trigger-element"); // change name here

Apparently I wrote notes twice. TODO merge.

Official Website

Alternatives:

Library for browser manipulation. Supports both Firefox and Chrome.

import puppeteer from 'puppeteer';

(async () => {
  // Launch the browser and open a new blank page
  const browser = await puppeteer.launch();
  const page = await browser.newPage();

  // Navigate the page to a URL
  await page.goto('https://developer.chrome.com/');

  // Set screen size
  await page.setViewport({width: 1080, height: 1024});

  // Type into search box
  await page.type('.devsite-search-field', 'automate beyond recorder');

  // Wait and click on first result
  const searchResultSelector = '.devsite-result-item-link';
  await page.waitForSelector(searchResultSelector);
  await page.click(searchResultSelector);

  // Locate the full title with a unique string
  const textSelector = await page.waitForSelector(
    'text/Customize and automate',
  );
  const fullTitle = await textSelector?.evaluate(el => el.textContent);

  // Print the full title
  console.log('The title of this blog post is "%s".', fullTitle);

  await browser.close();
})();

const browser = await puppeteer.launch({
  browser: 'firefox',
});

C++ Template Image Processing Library

cimg.eu website

brew install xquartz

Clojure

Clojure Basics

membership checks:

(some #{3} (vector 1 2 3)) ;

Excel and Spreadsheet Shoftware

Cheat sheet for Excel and every other spreadsheet software out there:

Fun with Terminals

Getting Terminal Size

Language	script
Python	os.get_terminal_size(fd=STDOUT_FILENO, /)

getting Computer specs

fastfetch

Embarcadero C++ Compiler

Embarcadero

Paperbak by Ollydbg

Paperbak for backing up data on paper.

Evidently doesn’t work unless the printer specs are accessible. No offline exports, must have an online printer.

Compiling

idk how to compile

Wine

On systems other than windows, Wine to the rescue.

QR Backup

https://github.com/za3k/qr-backup/

Boilerplate Template:

const std = @import("std");

pub fn hello() void {
    std.debug.print("Hello", .{});
}

pub fn main() void {
    hello();
}

Existing Resources

The zig docs are horrible.

All existing Zig resources end here: Zig Learn list

Written 25th Jan 2026, Zig version 0.15.2

Allocators

zig.guide on Allocators

C Interop

const c = @cImport({
    @cInclude("stdio.h");
});

CompileTime

Zig is strict, and that’s its point. I recommend just agreeing to its demands instead of fighting them.

Lists and Arrays

Zig Guide

const a = [5]u8{ 'h', 'e', 'l', 'l', 'o' };
const b = [_]u8{ 'w', 'o', 'r', 'l', 'd' };
std.debug.print("{any}", .{a});

Math

Math standard library docs

Zig File IO

const std = @import("std");
pub fn main() !void {
    const cwd = std.fs.cwd();
    const file = try cwd.createFile("example.txt", .{});
    defer file.close();
    const content = "Hello, Zig File I/O!\n";
    try file.writeAll(content);
    std.debug.print("File written successfully.\n", .{});
}

Keyboard shortcuts

Scream Logbook