My dotfiles are currently private, but they contain my fish functions (aliases), my yasnippets and cheats
Komputeer Ussah #
As a non-ai system, I like to interact with a physical computer. I like its novelty.
- Music: lofi.cafe | earth.fm | threesixfive | Radio Garden | 90’s TV | relax//five | chiptune
- Info: tosdr | W3Survey 🌟 | undertheradar | webcompact | endoflife.date | Farside | Climate Reanalyzer | BrutalistReport
- Conversion/Gen: onlinelisttools | Squoosh | transform.tools | Barcode Generator | QR Code Gen | Metric-time
- Free computers: WINDOWS93 | SegFault | Virtual x86 WASM | WebVM
General development #
Now how I do development has varied over the years. But I am constantly updating it.
- Urgent AF
- Sooner the better
- Re-start OSS contributions, start maintaining some projects and packages of interest.
- Learn how to use sourcegraph for codesearch better
- Lazy Sunday
- I think I want to run gprofiler on my machine
- Check out these search related projects and see how they work UTH, stork, meilisearch, edgesearch, pagefind
- Check if I can use runno in my blog
- Check if want to adopt renovatebot
- Exploration: CyberChef | AST explorer | Text Encoding Detect
- Helper tools: githistory | hadoukenify | starhistory | gh-badges | SpeedSheet
- Reference: hyperpolyglot | ManKier | OWASP Cheats | coreutils | DADS | OEIS
- Numbers: units | facts | File Magic Numbers | managing units
Editing text #
I didn’t really care what my editor was until I met neel and pritam in my previous workplace.
- Urgent AF
- Sooner the better
- Lazy Sunday
- 95% doom emacs(heavily customized), 5% neovim
- I think I spent half of my year last year fighting with emacs, had me learn little bit of elisp and I am not sure if it was worth it, but if there’s one thing I cannot live without, it has to be
org-mode
. helluvadrug. - For documentation lookup inside emacs,
eldoc
(usingelglot
),M-x man
,dev-docs
custom bindings foreww
. - When I quickly need to check the contents of a repo, I use GitHub1s , pretty neat stuff. I use Replit for quick prototypes etc, pretty neat but need to get back offline as soon as I need to do anything that involves more than 2 files(when writing from scratch).
Interface and dependencies #
- Urgent AF
- Sooner the better
- Lazy Sunday
- Checking how test containers and dev containers compare to my LXD workflow
- Checkout NixOS
- I am planning to write some aliases and function wrapper around ffmpeg and imagemagick for regular stuff. Most probably there are good tools out there, have to check.
fish
is my shell, have a love hate relationship ngl.pacman
andparu
mostly have me covered- For different versions of stuff, I use
asdf
+direnv
. I really like the global, local flexibility thatasdf
gives. - For virtual environments, I use
LXD
system containers with a custom cloud-init script. It’s pretty neat. Thanks to the co-workers at my last workplace! (See my notes on lxd ) - svu is great for quick help on semantic versions
- entr and running tests in watchmode is essential
Language specific #
JS/TS #
- Urgent AF
- Getting better at Typescript
- Sooner the better
- Experiment w workers and nodejs threadpool libraries.
- Lazy Sunday
- Need to check what is unifiedjs
- Info: Package Phobia | bundlephobia
Python #
- Urgent AF
- Need to check fastapi has to offer
- Sooner the better
- Check memray and gaogaotiantian/viztracer
- Lazy Sunday
- Checkout tqdm and more-itertools, toolz
- Check tuna, jamesturk/jellyfish (create something), networkx
- Use cog in one of my projects, it’s the embed go thing in markdown that i used
- Info: PyPI Data
- Reference: Common Gotchas
- I use asdf + poetry for all my python virtual env setups. Even if it’s a project with a
requirements.txt
, I use poetry to create a venv there and pip install on it. I don’t think i’ll ever understand python virtual environments completely so I am going for the path of least resistance - Understanding python’s import system has done me wonders
pudb
withipython
is pretty neat for debugging- I don’t have any linting, formatter preference honestly I just use the defaults that work with my editor setup. If any project needs specific style, the CI/CD system should catch it.
- Once joblib
was very useful to me but I can’t exactly remember when (also
more-itertools
)
Golang #
- Urgent AF
- Try out failsafe-go
- Try out samber/lo (lodash for go)
- Sooner the better
- check autogold
- Lazy Sunday
- I don’t think I’ll immediately need it but gotraceui looks neat
- Haven’t done anything in a while
C #
- References: C coding style
Ocaml #
- References: OCaml Syntax Cheatsheet
Domain specific #
Web #
Working on web things is fun, I am terrible at anything that involves css but I think it’s pretty neat.
- Urgent AF
- Really grokking HTTP, Headers, Cache, Cookies and Sessions
- Experimenting w WebAssembly, webworkers other web engineering fun.
- Experiment w backends offering user auth, pocketbase, supabase.
- I think I need to explore webcomponts etc. what’s all the fuss about.
- Also hypermedia. damn.
- Sooner the better
- Experimenting w serverless functions (Mostly cf workers)
- Faking libraries are great, need to see which one to use when. Candidates, json-server, faker, json-schema-faker,msw
- Explore more in web security side of things
- Check out API testing stuff: stepci, scanapi, oha
- Lazy Sunday
- Check puck, if we can do something similar for svelte
- Elixir, Phoenix and LiveView.
- LiveView is different in a way that instead of using HTTP and large-grain data exchange, it uses websockets and sends fine-grained updates.
- Info/Exploration: caniuse | Browserleaks | KeyCDN Tools | CSP Evaluator | Authentication Test | Request Catcher | WebBrowserTools
- References: rosettatype/hyperglot | image codec | DOM Events | worker playground | TLSFast | Console Utilities API reference
- CSS & Animations: Almanac | Animista | Type Scale | Utopia | shadcn/ui | tailwind cheat
- SVG: SVG Artista | SVG Reference | SVGcode
- Toolchain: Import Map
- API/Requests: httpbin | REDbot Caching | Mozilla Observatory
- Better no-code: mmm.page
- Everything I learn here becomes obsolete in about six months
- But I like the web and I want to build on it too
- I am too bad at anything involving CSS so, tailwindcss is my best friend here.
- I once tried doing react+vite+storybook with all the right config and other stuff, later I felt that I don’t want to be worrying about a static site so much. So static sites or semi-static sites are basically an org-mode export or a next.js site for me now.
- I think I learned react about 3 times and everytime, the documentation gets overhauled(good thing). But the last time I learned react, I took notes .
- Don’t ask me about framework preferences. I don’t think I agree with myself here.
- I played around w using verb for documenting api calls. I like it. It’s not suitable for all usecases but for some its gold. Otherwise insomnia or postman as required.
- Finally tried svelte with my wscribe-editor project, it was fun. But need to play with it more to have better gasp.
UI & Interface #
I like building small tools and usually they need interfaces.
- Urgent AF
- CLI stuff: imtui, Textualize, tview, bubbletea, ink
- Sooner the better
- Lazy Sunday
- Check out GUI stuff: wailsapp/wails, tauri, fyne, imgui, lvgl
Systems #
This includes all things systems.
- Urgent AF
- Sooner the better
- Check if I can write scripts faster with google/zx
- Lazy Sunday
- I don’t know many c/cpp libraries but would try to use zpl-c/zpl next time I get an opportunity to work on something similar.
- I don’t play w proto stuff that much but think protodot could be v.useful
- Learn what multiformats is about. Specifically interested in multibase.
- Memory profiling is interesting, I never got to try gdb, rr(tried rr, some issues in nixos), valgrind and friends properly. So someday/someweek might hack around and see how these can be useful. Valgrind and Address sanitizers, simpler tools like bytehound
- Cool tool to see changes before making, check it out
- Debugging: godbolt | explainshell | Dogbolt
- Reference: coreutils | Sysctl Explorer | procps-ng | sh-bible | Map of Linux
Distributed systems & sync & offline #
- Urgent AF
- Sooner the better
- Play w maelstrom probably via the fly.io challenge
- Lazy Sunday
- Check out stateright
- Play w sync libs yjs and automerge
- Play w Replicache, Ditto
Network programming & P2P #
I love networks, I love p2p more.
- Urgent AF
- Experimenting w websockets, WebRTC and other fun stuff
- Sooner the better
- Lazy Sunday
- Check if shadow simulator will be useful to run p2p/learning experiments
- Tools: BGP.Tools
Programming languages #
Creative programming & HCI #
So these are things I am just starting to learn. Creative programming is something I want to do for fun, HCI is something that really interests me. I have syllabus entries for it aswell iirc.
- Urgent AF
- Sooner the better
- Lazy Sunday
- Reference: Web render benchmarks
- Showcases: Explorable Explanations | awesome-explorables | wolframdemos
- Helper tools: drawingbots | SPACE TYPE | shapecatcher
- Layouts and elements: 98.css | winbox | RoughNotations | cursor-effects | omnio
Data #
Database #
- Urgent AF
- Check centerofci/mathesar and see if can help in learning
- Go through the excellent MySQL intermediate series by PlanetScale
- Sooner the better
- Experimenting more with SQLite (and ecosystem), Postgres (and ecosystem), Clickhouse, DuckDB, Redis.
- Lazy Sunday
- Check what’s PRQL’s about
- Checkout sqlglot - sql parser
- Resources: DB-Engines Ranking | Database of Databases | Troublesome words in SQL
- PG: PG Lock Conflicts | Postgres locks explorer | PGTune | PostgreSQL Observability | postgresqlco | pg-browser(wasm)
- PG EXPLAIN viz: EXPLAIN Visualizer(pev) | Explain Viz
- I don’t play with DBs on the daily but plan to.
Data Engineering #
- Urgent AF
- Sooner the better
- Lazy Sunday
- Try out steampipe
jq
wijq
has been useful in the past. I think there are 2 totally different projects namedijq
, it’s the one that I have installed.dasel
was also pretty neat once.
Data Analysis/Viz #
- Urgent AF
- Try viz platforms: Datawrapper, Desmos, ObservableHQ, quarto, rath
- Sooner the better
- Lazy Sunday
- Try viz tools: D3, SandDance, ObservablePlots, Vega, plouc/nivo.
- Check out Directus, baserow, nocodb if it can replace airtable for me.
- Play w kats
- Check out Gephi Lite, Perspective, Quadratic, marimo
- check nomic atlas
- Showcases: Visualization Browser | Flowing Media | datavizproject
- References: Eng Statistical Methods
- I use Airtable extensively as my data-store for things. I’ll probably move to something else if I ever hit limits.
- Occasionally I’d use Datasette but I want to use more of it. esp the sqlite-utils stuff looks interesting.
- To explore datasets I use visidata. It is awesome . Not only csv, parquet but also json, sqlite, postgres, shapefiles/mbtiles, pcap files! etc.
AI/ML experiments #
I by no means know anything about what’s happening in that space but I’ve been watching from far and I can tell, I cannot afford to blink. I have to take the dive sometime. I already have courses and stuff lined up and brushing up on math.
- Urgent AF
- Properly checkout Huggingface and what can I do with auto ML?
- Check Web AI Model Testing
- Sooner the better
- Check if I can add semantic search to my wiki using txtai and stenence transformers
- Check label-studio and if I can use it for some of my usecases
- Lazy Sunday
- Visualizers: netron | Attention Viz | Diffusion Explainer | VRAM Calculator
- Reference: Cloud GPU Guide | Timeline of AI Models | LLM Benchmarks
- Leaderboards: OpenLLM | HumanEval | lmsys | AlpacaEval |oobabooga | chatbot
- Tools: chub | lllmahub
- When SD came out, played a lot with AUTOMATIC1111
Archiving and Scraping #
- Urgent AF
- Sooner the better
- Check webrecorder and friends
- Setup archivebox, I feel guilty because I don’t contribute to the archive-warrior team and use their service heavily. I’ll 100% contribute once I start making money or something.
- Lazy Sunday
- Check out out kiwix, Internet in a Box, piratebox, dwebmirror
- I need to setup linkchecker in my sites, candidates are muffet(used prev), deadlink, lychee, awesome_bot and linkinator. I also want to write my own link checker but if one of these work out, which i think it would g2g.
- Query: Quarry for Wikipedia
- Bot detection tests: Bot / Headless Chrome Detection Tests | Pixelscan | Antibot | CreepJS | Detect WebGL Fingerprint
- If the page is somewhat structured, Can use underlying parsers(lxml, html5lib, requests-html etc.) directly. See my Reconnaissance Checklist :)
- Playwright
: When requirement is rendered browser.
- Playwright > Puppeter > Selenium
- Randomize mouse movements, consistent combination of device to emulate, slow_mo option, brave browser etc
- Support multiple web browsers, such as Chromium, Firefox, and Webkit-based Safari, out of the box
- Suggestions: playwright_stealth , Making Chrome Headless Undetectable , recorder and codegen , crawlee(anti-bot/scraping framework)
- Scrapy
: Fist thing to reach out for.
- Useful for complex projects that require scraping multiple sites in various ways. ez flow when no anti-bot.
- Suggestions: scrapy-splash , adv-scrapy-proxies
- BS4
- Minimal version of Scrapy with only a fraction of the functionality. Good for unstructured HTML pages
- Use it for simple projects where all you need to do is scrape the elements of one web page.
- Extensions: MechanicalSoup
- cheerio : Like BS4 but in Javascript
- colly : Like Bs4 but in Golang, no js rendering.
Geo stuff #
I am interested in maps because it’s crazy how we managed to actually map the real world into some other form and reason about. It’s just mind blowing to me. Basically I think it’s a notation and notations are fascinating to me. Also I want to do a lot of geo based visualizations and study.
- Urgent AF
- Sooner the better
- Checkout felt
- Lazy Sunday
- Check out Literate Visualization for I am a sucker for Literate programming
- Try out Every Door and StreetComplete and see which one I’d want to use
- Check terra-draw
- Map services: mapy.cz(see this) | mapcomplete
- Helper tools: OSM filter | mapshaper | BBBike extract
- Reference: Web maps examples
- Others: GPSJAM GPS/GNSS Interference Map
- The openinfra map is interesting
- I really need to make a page for all map stuff man
Infra & Network & Security #
Infrastructure experiments #
- Urgent AF
- Haven’t played w containers in a while, get upto speed w podman. Also check, distroless and slim
- Check if I should include earthly and ctop to my workflow, also see cdebug
- Haven’t touched k8s in a while, kubectx & kubens, k9s, lens
- Sooner the better
- Check tunneling stuff
- think useful k8s-capacity, netshoot, krane, kubiscan
- I plan to manage my personal infra via nomad so need to check that out.
- Play w localstack
- I like pipes and glued together scripts but node based automation is probably more useful in certain cases, checkout n8n
- Lazy Sunday
- some file sharing tools
- steampipe looks interesting, problem is i do not have monie for cloud but would explore, would this work w localstack? hmm.
- I currently use goatcounter free on my homepage, but I find it a little rigid for my workflow. I want to checkout alternatives and status pages for my other services etc.
- Hit my stuff w k6
- Reference: CPU info | GPU info | CIDR.xyz | syscall table
- Tools: traefik.me (xip.io, wildcard dns) | dns.netmeister.org
- Info: DOH providers
- Ansible and Github actions are enough for my regular automation
- See my summary on Logging
- I haven’t fiddled with infra stuff in a while but I plan to streamline things eventually.
- Mostly use github and bitbucket for hosting code repositories
- Netlify or Vercel for semi-static sites
- Have not got around selfhosting stuff yet, except locally on my pi/laptop when it makes sense.
- I mostly use github actions for personal projects, I found that the local runner
act
is only useful for basic things like debugging why some environment variable etc is not getting set, playing around with “contexts” etc. Neat tool when learning.
Observability stuff #
- Urgent AF
- Sooner the better
- Need to check how useful continuous profiling be for my usecases, parca, pyroscope
- Lot of logging tools, some of these I used once or twice but want to do proper check and write a comparison blogpost as a summary maybe and link it back here. angle-grinder, logmine, rhit(nginx), goaccess, lnav, pidcat
- Lazy Sunday
Security, Network and Tinkering #
- Urgent AF
- Often find myself needing to inspect AF_UNIX, I am not sure how to do it w socat/tcpdump but this one using ebpf looks interesting: sockdump
- Sooner the better
- Check out assh for managing ssh stuff
- Check cilium/pwru and sniffnet, also check if nudin/iptable_vis does what it says because it’ll be so cool.
- l7 tcpdump: netpeek
- Lazy Sunday
- Investigation: PimEyes | Browserleaks | εxodus android | dnsdumpster
- Vulnerabilities: OSV Database | OpenCVE(signed-in) | HackerOne Hackactivity
- Tools: adhoc webhook
- Reference: GTFOBins | LOLBAS
- Info: CPU info | GPU info | SLSA
- Visual: CIDR.xyz | Virtual x86 WASM
- I have a dedicated page called Plumber Manual for things related to this.
- vulnix is pretty cool, it lists the CVEs for your installed packages and then you can spend hours reading source-code of the dependencies you use and also learn a thing or two about security.
Non-dev #
Planning/Brainstorming/Curation #
- Mindmapping: Kinopio
- Diagramming: Swimlanes, text-to-diagram-tools-comparision 🌟 (maybe selfhost this)
- Helpful tools: Loudreader
org-mode
supremacy, notion and various markdown wiki veteran.- I have a page dedicated to notetaking
- Github issues and Linear for project progress tracking.
- Key is to think how to think about the specific problem and choose tools based on that. Meta.
Communication and Discussions #
- Translations: Words2Emoji | emojikitchen
- Deciding: dont.build | Bootstrapping Calculator
- Search: netsplit | IRC Driven | subredditstats
- I have a communities page but I have serious problems communicating my thoughts, but that’s another story.
- Chat
- Matrix: Element as the backend , cinny as the chat ui
- IRC: The Lounge runs locally on my pi
- Telegram, WhatsApp, Signal, Discord
- Email
- Gmail, Zoho Mail (K9, Delta Chat) w SimpleLogin
Research #
I have never done any real research but I want to experiment things and write about those this formally. I have some nice stuff in syllabus which I’ll move over here when I go through them.
- Urgent AF
- Sooner the better
- Check mathpix
- Lazy Sunday
- I’ve been planning to setup a nice zotero & org-ref workflow but I am not an academic and I am not exactly sure how things will play out.
Match & Problem solving #
- Calculators: derivative | integral
Misc #
Music #
Art/Design #
- Urgent AF
- Sooner the better
- Well, video editors. Long story. Anyway need to check LosslessCut, Runway, Source Filmmaker, remotion, FFrames
- Check muted and making videos
- Lazy Sunday
- Experiment more with MagicaVoxel
- Experiment w pixel editors, rx, pixelcraft, piskel, aseprite
- Try creating some posters with sharkdp/binocle and do some weird shit
I wants to do art/design but not at the moment. I also wanted to make weird game videos using assets etc (Neel, if you ever read this, yeah still at it). But I might have to pause that for a while as it does not directly feed into my primary goals but I definitely want to make time for it.
Mobile experiments #
- Urgent AF
- Sooner the better
- Lazy Sunday
- Some emulation tools I want to try, remote-android/redroid-doc, scrcpy
- I want to check some apps, see if this helps
- Tools: Mobile JS console
Generated #
These following lists are generated here and not in sync with my system at all times.
Firefox Extensions #
Name | Description |
---|---|
Sidebery | Addon for managing tabs, containers (contextual identities) and bookmarks in sidebar. Supports both flat and tree tabs layouts, per-container include/exclude rules, proxy configs for each container and much more. |
Auto Tab Discard | Increase browser speed and reduce memory load when you have numerous open tabs. |
Impulse Blocker | Block distracting websites when you are browsing the web. |
Imagus | Enlarge thumbnails, and show images/videos from links with a mouse hover. |
Cookie Quick Manager | An addon to manage (view, search, create, edit, delete, backup, restore) cookies. |
What Hacker News Says | Easily find Hacker News threads about the page you’re currently browsing. |
WhatFont | A wrapper for Chengyhin Liu’s WhatFont tool |
Debug CSS | Adds outline to all elements on the page to show the culprit element which is changing desired layout |
Video Speed Controller | Speed up, slow down, advance and rewind HTML5 audio/video with shortcuts |
Tridactyl | <nil> |
ClearURLs | Remove tracking elements from URLs. |
Web Archives | View archived and cached versions of web pages on 10+ search engines, such as the Wayback Machine, Archive․is, Google, Bing and Yandex |
Enhancer for YouTubeâ„¢ | Take control of YouTube and boost your user experience! |
SimpleLogin:Receive & Send emails anonymously | Easily create a different email for each website to hide your real email. Protect your inbox against spams, phishing, data breaches |
Consent-O-Matic | Automatic handling of GDPR consent forms |
Violentmonkey | An open source userscript manager that supports a lot of browsers |
MarkDownload - Markdown Web Clipper | This extension works like a web clipper, but it downloads articles in markdown format. |
Smart TOC | Webpage outliner |
Dark Reader | Dark mode for every website. Take care of your eyes, use dark theme for night and daily browsing. |
Hello, Goodbye | Hello, Goodbye blocks annoying chat widgets. |
I don’t care about cookies | <nil> |
Tab Stash | A no-fuss way to save and restore batches of tabs as bookmarks. |
Library Extension | <nil> |
Stylus | Redesign the web with Stylus, a user styles manager. Stylus allows you to easily install themes and skins for many popular sites. |
React Developer Tools | Adds React debugging tools to the Firefox Developer Tools.Created from revision 2468a8735 on 5/19/2023. |
Reddit Enhancement Suite | A suite of modules that enhance your Reddit browsing experience |
Emoji | Insert emojis using a web browser, and customise the experience and the add-on in Settings. |
SponsorBlock for YouTube - Skip Sponsorships | Skip sponsorships, subscription begging and more on YouTube videos. Report sponsors on videos you watch to save others' time. |
Refined GitHub | Simplifies the GitHub interface and adds useful features |
Control Panel for Twitter | Gives you more control over Twitter and adds missing features and UI improvements |
Flagfox | Displays a flag depicting the location of the current server |
LocalCDN | Protects you against tracking through CDNs (Content Delivery Networks) by redirecting to local resources. |
Bitwarden - Free Password Manager | A secure and free password manager for all of your devices. |
uBlacklist | Blocks sites you specify from appearing in Google search results |
Zotero Connector | Save references to Zotero from your web browser |
uBlock Origin | Finally, an efficient blocker. Easy on CPU and memory. |
Arch Official Packages #
Name | Description |
---|---|
adobe-source-han-sans-jp-fonts | Adobe Source Han Sans Subset OTF - Japanese OpenType/CFF fonts |
age | A simple, modern and secure file encryption tool |
aircrack-ng | Key cracker for the 802.11 WEP and WPA-PSK protocols |
alacritty | A cross-platform, GPU-accelerated terminal emulator |
alsa-utils | Advanced Linux Sound Architecture - Utilities |
ansible | Official assortment of Ansible collections |
ansible-lint | Checks playbooks for practices and behaviour that could potentially be improved. |
arandr | Provide a simple visual front end for XRandR 1.2. |
atop | A system and process level monitor |
bandwhich | Terminal bandwidth utilization tool |
base | Minimal package set to define a basic Arch Linux installation |
base-devel | Basic tools to build Arch Linux packages |
bash-language-server | Bash language server implementation based on Tree Sitter and its grammar for Bash |
bat | Cat clone with syntax highlighting and git integration |
beep | Advanced PC speaker beeping program |
biber | A Unicode-capable BibTeX replacement for biblatex users |
bluez-utils | Development and debugging utilities for the bluetooth protocol stack |
bmon | Portable bandwidth monitor and rate estimator |
bottom | A graphical process/system monitor |
bpftrace | High-level tracing language for Linux eBPF |
brightnessctl | Lightweight brightness control tool |
catimg | Print images in a terminal with 256 colors support |
cgasm | CLI tool for browsing documentation for x86 Assembly |
chafa | Image-to-text converter supporting a wide range of symbols and palettes, transparency, animations, etc. |
cloudflared | Command-line client for Cloudflare Tunnel |
cmake | A cross-platform open-source make system |
cmus | Feature-rich ncurses-based music player |
cool-retro-term | A good looking terminal emulator which mimics the old cathode display |
cowsay | Configurable talking cow (and a few other creatures) |
curlie | The power of curl, the ease of use of httpie. |
dbeaver | Free universal SQL Client for developers and database administrators (community edition) |
diffoscope | Tool for in-depth comparison of files, archives, and directories |
discord | All-in-one voice and text chat for gamers |
dive | A tool for exploring layers in a docker image |
dog | Command-line DNS client like dig |
dstat | A versatile resource statistics tool |
dua-cli | A tool to conveniently learn about the disk usage of directories, fast! |
duf | Disk Usage/Free Utility |
earlyoom | Early OOM Daemon for Linux |
ebook-tools | Tools for accessing and converting various ebook file formats |
editorconfig-core-c | EditorConfig core code written in C (for use by plugins supporting EditorConfig parsing) |
element-desktop | Glossy Matrix collaboration client — desktop version. |
emacs-nativecomp | The extensible, customizable, self-documenting real-time display editor with native compilation enabled |
entr | Run arbitrary commands when files change |
eva | simple calculator REPL, similar to bc(1) |
evtest | Input device event monitor and query tool |
eza | A modern replacement for ls (community fork of exa) |
fd | Simple, fast and user-friendly alternative to find |
feh | Fast and light imlib2-based image viewer |
figlet | A program for making large letters out of ordinary text |
firefox | Standalone web browser from mozilla.org |
fish | Smart and user friendly shell intended mostly for interactive use |
gfold | A CLI tool to help keep track of Git repositories |
ghidra | Software reverse engineering framework |
gimp | GNU Image Manipulation Program |
git-delta | Syntax-highlighting pager for git and diff output |
glances | CLI curses-based monitoring tool |
glow | Command-line markdown renderer |
gnu-netcat | GNU rewrite of netcat, the network piping application |
gopls | Language server for Go programming language |
gping | Ping, but with a graph |
grex | A command-line tool for generating regular expressions from user-provided input strings |
grim | Screenshot utility for Wayland |
heaptrack | A heap memory profiler for Linux |
hexyl | Colored command-line hex viewer |
htop | Interactive process viewer |
httrack | An easy-to-use offline browser utility |
hugo | Fast and Flexible Static Site Generator in Go |
hunspell-en_us | US English hunspell dictionaries |
hyperfine | A command-line benchmarking tool |
imv | Image viewer for Wayland and X11 |
intel-ucode | Microcode update files for Intel CPUs |
inter-font | A typeface specially designed for user interfaces |
interception-dual-function-keys | Interception plugin for dual-function keys: Tap for one key, hold for another |
iotop | View I/O usage of processes |
iwd | Internet Wireless Daemon |
jedi-language-server | Language server for Jedi |
john | John the Ripper password cracker |
keychain | A front-end to ssh-agent, allowing one long-running ssh-agent process per system, rather than per login |
kismet | 802.11 layer2 wireless network detector, sniffer, and intrusion detection system |
kmon | Linux kernel manager and activity monitor |
libmicrodns | Minimal mDNS resolver library |
libreoffice-still | LibreOffice maintenance branch |
linux-firmware | Firmware files for Linux |
lnav | A curses-based tool for viewing and analyzing log files |
lolcat | Okay, no unicorns. But rainbows!! |
lostfiles | Find orphaned files not owned by any Arch packages |
lshw | A small tool to provide detailed information on the hardware configuration of the machine. |
lsof | Lists open files for running Unix processes |
ltrace | Tracks runtime library calls in dynamically linked programs |
lxd | Daemon based on liblxc offering a REST API to manage containers |
macchanger | A small utility to change your NIC’s MAC address |
maim | Utility to take a screenshot using imlib2 |
mako | Lightweight notification daemon for Wayland |
man-db | A utility for reading man pages |
man-pages | Linux man pages |
mediainfo | Supplies technical and tag information about media files (CLI interface) |
miller | Name-indexed data processing tool |
mold | A Modern Linker |
mpv | a free, open source, and cross-platform media player |
nasm | 80x86 assembler designed for portability and modularity |
neofetch | A CLI system information tool written in BASH that supports displaying images. |
neovim | Fork of Vim aiming to improve user experience, plugins, and GUIs |
nethogs | A net top tool which displays traffic used per process instead of per IP or interface |
nfs-utils | Support programs for Network File Systems |
ngrep | A grep-like utility that allows you to search for network packets on an interface. |
nix | A purely functional package manager |
nmap | Utility for network discovery and security auditing |
noto-fonts-cjk | Google Noto CJK fonts |
ntfs-3g | NTFS filesystem driver and utilities |
nyancat | Nyancat rendered in your terminal. |
obs-studio | Free, open source software for live streaming and recording |
okular | Document Viewer |
ollama | Create, run and share large language models (LLMs) |
onefetch | Git repository summary on your terminal |
opam | OCaml package manager |
opensnitch | A GNU/Linux application firewall |
pacman-contrib | Contributed scripts and tools for pacman systems |
pacutils | Helper tools for libalpm |
paperkey | Archive OpenPGP keys on paper |
parallel | A shell tool for executing jobs in parallel |
pass | Stores, retrieves, generates, and synchronizes passwords securely |
pdfarranger | Helps merge or split PDF documents and rotate, crop and rearrange pages |
perl-file-mimeinfo | Determine file type, includes mimeopen and mimetype |
perl-image-exiftool | Reader and rewriter of EXIF information that supports raw files |
pgformatter | A PostgreSQL SQL syntax beautifier |
pipewire-alsa | Low-latency audio/video router and processor - ALSA configuration |
pipewire-pulse | Low-latency audio/video router and processor - PulseAudio replacement |
podman | Tool and library for running OCI-based containers in pods |
postgresql | Sophisticated object-relational DBMS |
prettier | An opinionated code formatter for JS, JSON, CSS, YAML and much more |
procs | A modern replacement for ps written in Rust |
progress | Shows running coreutils basic commands and displays stats |
pueue | A CLI tool for managing long running shell commands |
pv | A terminal-based tool for monitoring the progress of data through a pipeline |
python-isort | A Python utility / library to sort Python imports |
python-pipx | Install and Run Python Applications in Isolated Environments |
python-pynvim | Python client for Neovim |
qbittorrent | An advanced BitTorrent client programmed in C++, based on Qt toolkit and libtorrent-rasterbar |
qrencode | C library for encoding data in a QR Code symbol. |
refind | An EFI boot manager |
reflector | A Python 3 module and script to retrieve and filter the latest Pacman mirror list. |
ripgrep-all | rga: ripgrep, but also search in PDFs, E-Books, Office documents, zip, tar.gz, etc. |
rust-analyzer | Rust compiler front-end for IDEs |
sad | Space Age seD |
scrcpy | Display and control your Android device |
sd | Intuitive find & replace |
shellcheck | Shell script analysis tool |
shellharden | Bash linter and syntax highlighter |
shfmt | Format shell programs |
slurp | Select a region in a Wayland compositor |
smartmontools | Control and monitor S.M.A.R.T. enabled ATA and SCSI Hard Drives |
sniffnet | Application to comfortably monitor your network traffic |
ssh-audit | SSH configuration auditing |
sshfs | FUSE client based on the SSH File Transfer Protocol |
starship | The cross-shell prompt for astronauts |
strace | A diagnostic, debugging and instructional userspace tracer |
streamlink | CLI program that launches streams from various streaming services in a custom video player (livestreamer fork) |
svelte-language-server | Language server for Svelte |
swappy | A Wayland native snapshot editing tool |
sway | Tiling Wayland compositor and replacement for the i3 window manager |
swayidle | Idle management daemon for Wayland |
swaylock | Screen locker for Wayland |
syncthing | Open Source Continuous Replication / Cluster Synchronization Thing |
sysstat | a collection of performance monitoring tools (iostat,isag,mpstat,pidstat,sadf,sar) |
tailscale | A mesh VPN that makes it easy to connect your devices, wherever they are. |
tcpdump | Powerful command-line packet analyzer |
tcpflow | Captures data transmitted as part of TCP connections then stores the data conveniently |
tectonic | Modernized, complete, self-contained TeX/LaTeX engine, powered by XeTeX and TeXLive |
telegram-desktop | Official Telegram Desktop client |
termshark | Terminal UI for tshark, inspired by Wireshark |
texlive-fontsrecommended | TeX Live - Recommended fonts |
texlive-latexextra | TeX Live - LaTeX additional packages |
texlive-plaingeneric | TeX Live - Plain (La)TeX packages |
texlive-xetex | TeX Live - XeTeX and packages |
thunderbird | Standalone mail and news reader from mozilla.org |
tmux | Terminal multiplexer |
tokei | A blazingly fast CLOC (Count Lines Of Code) program |
traceroute | Tracks the route taken by packets over an IP network |
trash-cli | Command line trashcan (recycle bin) interface |
ttf-firacode-nerd | Patched font Fira (Fura) Code from nerd fonts library |
ttf-jetbrains-mono-nerd | Patched font JetBrains Mono from nerd fonts library |
typescript-language-server | Language Server Protocol (LSP) implementation for TypeScript using tsserver |
unarchiver | unar and lsar: Objective-C tools for uncompressing archive files |
up | A tool for writing Linux pipes with instant live preview |
usbip | An USB device sharing system over IP network |
vi | The original ex/vi text editor |
virtualbox | Powerful x86 virtualization for enterprise as well as home use |
visidata | Terminal spreadsheet multitool for discovering and arranging data |
wavemon | Ncurses-based monitoring application for wireless network devices |
waybar | Highly customizable Wayland bar for Sway and Wlroots based compositors |
webhook | A lightweight incoming webhook server to run shell commands |
websocat | Command-line client for web sockets, like netcat/curl/socat for ws:// |
whois | Intelligent WHOIS client |
wireshark-qt | Network traffic and protocol analyzer/sniffer - Qt GUI |
xdg-desktop-portal-wlr | xdg-desktop-portal backend for wlroots |
xorg-xwayland | run X clients under wayland |
yadm | Yet Another Dotfiles Manager |
yaml-language-server | YAML Language Server |
yt-dlp | A youtube-dl fork with additional features and fixes |
zathura-pdf-mupdf | PDF support for Zathura (MuPDF backend) (Supports PDF, ePub, and OpenXPS) |
zbar | Application and library for reading bar codes from various sources |
zoxide | A smarter cd command for your terminal |
Arch AUR Packages #
Name | Description |
---|---|
advcpmv | ‘cp’ and ‘mv’ utilities with progress bar patches |
ancient-packages | Lists installed packages no longer available (anywhere) |
anki-bin | Helps you remember facts (like words/phrases in a foreign language) efficiently. Installed with wheel. |
asdf-vm | Extendable version manager with support for Ruby, Node.js, Elixir, Erlang & more |
cbonsai | A bonsai tree generator, written in C using ncurses |
chars | Command line tool to display information about unicode characters. |
cheat | Allows you to create and view interactive cheatsheets on the command-line |
choose-rust-git | A fast, human-friendly alternative to awk(1) and cut(1) |
cinny-desktop-bin | Matrix client focusing primarily on a simple, elegant and secure interface (binary release) |
clipman | A simple clipboard manager for Wayland |
code-minimap | A high performance code minimap render |
cpufetch | Simple yet fancy CPU architecture fetching tool |
dasel | Query and update data structures from the command line. |
desed | Debugger for sed, written in rust. Step through code and observe sed inner state. |
electron19 | Build cross platform desktop apps with web technologies |
elfcat | Generates HTML files from ELF binaries |
fclones-bin | Efficient Duplicate File Finder |
firefox-tridactyl-native | Tridactyl native messaging host application for Firefox (native: 0.3.6) |
frangipanni | Program to convert lines of text into a tree structure |
gallery-dl | Command-line program to download image-galleries and collections from several image hosting sites |
gomi | Rm alternative written in Go |
google-chrome | The popular web browser by Google (Stable Channel) |
graphtage | A utility for semantically comparing and merging tree-like structures, such as JSON, XML, HTML, YAML, and CSS files. |
hostctl | Command-line tool to manage your hosts file |
hr-bash | A horizontal ruler for your terminal |
httpstat-go | It’s like curl -v, with colours. |
ijq | Interactive jq tool, like jqplay for the commandline |
imgp | Multi-core batch image resizer and rotator |
insomnia-bin | API Client and Design Platform for GraphQL and REST |
libtree | ldd as a tree |
loggedfs-git | Filesystem monitoring with Fuse |
nnn-nerd | The fastest terminal file manager ever written (with icon support using a patched nerd font). |
nwg-look-bin | GTK3 settings editor adapted to work w/ wlroots-based compositors (binary package) |
pacgraph | Draws a graph of installed packages to PNG/SVG/GUI/console. Good for finding bloat. |
paru | Feature packed AUR helper |
pmount | mount removable devices as normal user |
podman-tui | Podman Terminal User Interface |
procdump | Generate coredumps based off performance triggers |
programmer-calculator | A command line calculator made for programmers working with multiple number representations and close to the bits |
ps_mem | List processes by memory usage |
quickemu | Quickly create and run optimised Windows, macOS and Linux desktop virtual machines. |
sampler | A tool for shell commands execution, visualization and alerting. Configured with a simple YAML file. |
sftpgo-bin | Fully featured and highly configurable SFTP server with optional HTTP, FTP/S and WebDAV support. It can serve local filesystem, S3, GCS, Azure Blob, SFTP |
sfz | A simple static file server |
sshping | ssh-based ping: measure character-echo latency and bandwidth for an interactive ssh session |
sysz | fzf terminal UI for systemctl |
teip | Highly efficient “Masking tape” for standard input |
tsukae-git | Show off your most used shell commands |
ttf-twemoji | Twitter Color Emoji for everyone. |
typiskt | touchtype training in the terminal |
tz | A time zone helper |
vale | A customizable, syntax-aware linter for prose |
vlc-pause-click-plugin | Plugin for VLC that pauses/plays video on mouse click |
wev-git | Print wayland events, like xev(1) |
wlay-git | Graphical output management for Wayland |
wlsunset | Day/night gamma adjustments for Wayland compositors |
wofi-emoji-git | Emoji picker for Wayland using wofi and wtype |
xdg-ninja-git | A shell script which checks your $HOME for unwanted files and directories. |
zoom | Video Conferencing and Web Conferencing Service |
zotero-bin | Zotero Standalone. Is a free, easy-to-use tool to help you collect, organize, cite, and share your research sources. |
Mobile Apps #
Absolute dump. I use the List My Apps app to generate the csv, the csv is then uploaded to dropbox from where airtable pulls it. When generating the org file my custom script fetches from airtable. I did not want this to be a rube goldberg machine but there doesn’t seem to be a very clean way out in the way I need it at the moment.
Notion â—‹ Adobe Acrobat â—‹ Habits â—‹ GuitarTuna â—‹ Adobe Scan â—‹ Zomato â—‹ Embiggen â—‹ Snapseed â—‹ List My Apps â—‹ 1.1.1.1 â—‹ Ping Test Tool â—‹ F-Droid â—‹ PlantNet â—‹ Paytm â—‹ Quit Smoking â—‹ Binary â—‹ Tasker â—‹ Forest â—‹ Planta â—‹ Kite â—‹ Wolfram Alpha â—‹ Uber â—‹ Keep Notes â—‹ WhatsApp â—‹ Awesome QR â—‹ Track â—‹ Replit â—‹ Google Podcasts â—‹ CRED â—‹ Protractor â—‹ Pocket â—‹ Grapevine â—‹ Bluecoins â—‹ Url forwarder â—‹ AnkiDroid â—‹ Crayon â—‹ SoundCloud â—‹ Track & Graph â—‹ Unit Converter Ultimate â—‹ Pinterest â—‹ GitHub â—‹ VLC â—‹ Telegram â—‹ Airtable â—‹ Niagara Launcher â—‹ BHIM â—‹ Shazam â—‹ Drinkable â—‹ Goodreads â—‹ Wikipedia â—‹ Termux â—‹ Discord â—‹ Signal â—‹ Product Hunt â—‹ Coin â—‹ SimpleLogin â—‹ Syncthing â—‹ Tapo â—‹ Lithium â—‹ Snipd â—‹ Brave â—‹ NetGuard â—‹ PhonePe â—‹ HTTP Shortcuts â—‹ BigO â—‹ Splitwise â—‹ Relay Pro â—‹ Zoom â—‹ Binance â—‹ Just Another Workout Timer â—‹ Chess â—‹ WiFiAnalyzer â—‹ Tasks â—‹ Rapido â—‹ DiskUsage â—‹ TrebleShot â—‹ Authenticator
Datasets #
- Need to read this
Name | Remark | Category |
---|---|---|
Marvel Comics API | Marvel Comics API | [‘Fun’, ‘Media’] |
Security Datasets | Re-play Security Events | [‘Global’, ‘Tech’] |
emoji-data | Easy to parse data and spritesheets for emoji | [‘Fun’, ‘Code’] |
UK House Price Index | [‘Geo’, ‘Outside India’] | |
Payments System Data | Comprehensive one stop place for all accessing, visualizing payments system data (PSD) in India | [‘Finance’, ‘India’] |
farmsubsidy | Detailed data relating to payments and recipients of farm subsidies in every EU state | [‘Geo’, ‘Outside India’] |
Common Crawl | repository of web crawl data | [‘DNS’, ‘Documents’] |
taxonworks | web-based workbench for taxonomists and biodiversity scientists. | [‘Geo’] |
Umbrella Popularity List | The popularity list contains our most queried domains based on passive DNS usage | [‘Global’, ‘Code’, ‘DNS’] |
OS OpenData | Ordnance Survey OpenData | [‘Global’, ‘Geo’] |
Data Gov India | Data on India | [‘India’] |
yrno | Online weather service from the Norwegian Meteorological Institute | [‘Geo’, ‘Global’] |
daylightmap | Daylight is a complete distribution of global, open map data that’s freely available with support from community and professional mapmakers. | [‘Global’, ‘Geo’] |
Open Transit Data (Delhi) | IITD collab | [‘Geo’, ‘India’] |
lobbyfacts | Exposing lobbying in the European institutions | [‘Outside India’, ‘Documents’] |
GPT-4-LLM | Instruction GPT (GPT4 generated) | [‘LLM’] |
JusticeHub | Legal & Justice Data | [‘India’] |
wigglenet | Wireless network database | [‘Geo’, ‘DNS’, ‘Code’] |
handschriftenportal | Old manuscripts | [‘Documents’, ‘Media’] |
punpedia | Pun encyclopedia | [‘Fun’] |
emailserverlist | list of email providers and some data abt them | [‘DNS’] |
WorldAtlas | Pre-built TopoJSON from Natural Earth. | [‘Global’, ‘Geo’] |
Theatricalia | A database of past and future theatre productions | [‘Outside India’, ‘Fun’] |
SpaceX-API | Open Source REST API for SpaceX launch, rocket, core, capsule, starlink, launchpad, and landing pad data. | [‘Global’, ‘Fun’] |
Geolocation Database | IP - Geo Mapping | [‘Geo’, ‘DNS’] |
cities | 10,000 Cities with Latitude, Longitude, and Elevation | [‘Global’, ‘Geo’] |
Subtree of Life | relationships between different species. | [‘Geo’] |
Govt on github | Govts putting their stuff on github | [‘Global’, ‘Govt’] |
factbook | World Factbook Country Profiles in JSON | [‘Global’, ‘Geo’] |
asterank | asteroid database, interactive visualizations, and discovery tools | [‘Geo’, ‘Global’] |
GH Archive | GH Archive is a project to record the public GitHub timeline | [‘Code’] |
overturemaps | open map data intended primarily to demonstrate the potential and possibilities for open map data | [‘Global’, ‘Geo’] |
irail.be | iRail api allows anyone to query trains, stations, liveboards and connections. | [‘Geo’, ‘Outside India’] |
GPTeacher | Modular datasets generated by GPT-4 | [‘LLM’] |
Lobster users database | We can create a graph out of it | [‘Fun’, ‘Global’] |
postcodes | UK postcode & geolocation API, serving up open data | [‘Global’, ‘Geo’] |
mobilitydata | The Mobility Database catalogs is a repository of 1800+ mobility datasets across the world. | [‘Global’, ‘Geo’] |
USDA_Pomological_Watercolors | 7,500 Watercolor Paintings of Every Known Fruit in the World: Download Them in High Resolution | [‘Global’, ‘Media’] |
Icelandic Saga Database | online resource dedicated to publishing the Sagas of the Icelanders | [‘Outside India’, ‘Media’, ‘Documents’] |
Tranco | A Research-Oriented Top Sites Ranking Hardened Against Manipulation | [‘Global’, ‘Code’, ‘DNS’] |
samanantar | publicly available parallel corpora collection for Indic languages | [‘India’] |
Digitized Manuscripts | Digitized Manuscripts, Prints, Music, Maps, Photographs, Newspapers and Magazine | [‘Documents’, ‘Media’] |
OpenFlights | Various flight related data providers | [‘Geo’] |
opentopography | OpenTopography facilitates community access to high-resolution, Earth science-oriented, topography data, and related tools and resources. | [‘Global’, ‘Geo’] |
The Majestic Million | The million domains we find with the most referring subnets | [‘Global’, ‘Code’, ‘DNS’] |
PlaneCrashList | Plane crash rates by model | [‘Geo’, ‘Global’] |
Apple domains | [‘Global’, ‘Code’, ‘DNS’] | |
JSON Against Humanity | Cards Against Humanity® as plain text and JSON. | [‘Fun’] |
Yelp | The Yelp Dataset | [‘Global’] |
trustwallet/assets | A comprehensive, up-to-date collection of information about several thousands (!) of crypto tokens. | [‘Global’, ‘Finance’] |
geofabrik | we extract, select, and process free geodata for you. We create shape files, maps, map tiles and full-blown web mapping solutions. | [‘Global’, ‘Geo’] |
celestrak | understanding of our orbital environment and how to use it safely and responsibly. | [‘Global’, ‘Geo’] |
CrawlerNinja | Top 1 Million Sites Security Analysis | [‘Global’, ‘DNS’, ‘Code’] |
Ship Wreck Database 2 | [‘Fun’] | |
QuickWick/Music-AI-Voices | AI Voices | [‘Media’] |
opentreeoflife | comprehensive, dynamic and digitally-available tree of life | [‘Geo’] |
Digitalisierte Sammlungen | Digitalisierte Sammlungen der Staatsbibliothek zu Berlin | [‘Documents’, ‘Media’] |
GraphHopper Traffic | GraphHopper Open Traffic Collection | [‘Outside India’, ‘Geo’] |
CreativeCommons | CC stuff | [‘Documents’, ‘Media’] |
sportsdatabase | peer-to-peer sports data with the SDQL API | [‘Global’, ‘Sports’] |
Wikipedia Embeddings | Multilang Wikipedia Embeddings | [‘Documents’] |
Airframe | Something airport data | [‘Geo’] |
H1B salary DB | H1B salaray database , search and sort | [‘Outside India’, ‘Finance’] |
landconflictwatch | Tracking natural resource disputes in India | [‘Geo’, ‘India’] |
groundhogday | [‘Fun’] | |
Encyclopedia of Life | Encyclopedia of Life | [‘Geo’] |
PublicDataMarket | Random scraped datasets | [‘Global’] |
CF Radar | CF Internet data | [‘Geo’, ‘DNS’, ‘Code’] |
Ship Wreck Database | [‘Fun’] | |
gisgraphy | Open source geocoder and addresses / POIs databases | [‘Geo’, ‘Global’] |
naturalearthdata | Natural Earth you can make a variety of visually pleasing, well-crafted maps with cartography or GIS software. | [‘Global’, ‘Geo’] |