Self-Hosting on the Dark Web

(david.alvarezrosa.com)

217 points | by mooreds 15 hours ago ago

83 comments

  • p4bl0 an hour ago

    My personal website has been hosted on Tor for years. It's easy to do from your home even behind a NAT because it's an outgoing connection from your point of view (which also makes it a great way to expose local services even when you are behind a NAT and don't not have a static IP), and by design your personal IP is hidden from your visitors.

    I wrote about it in 2600 almost ten years ago (already?!). A copy of my article can be found here: https://pablorauzy.fr/outreach/2600/how-to-run-a-tor-hidden-...

    If you have an Onion copy of your website, don't forget the Onion-Location http header which will automatically redirect Tor Browser users to the onion version of the website even if they visit it at the clear web address.

    If it interests people, I also have a follow up article about I2P: https://pablorauzy.fr/outreach/2600/how-to-run-an-i2p-hidden...

  • ivanmontillam 10 hours ago

    What I really love about Onion sites is that if they are big enough, performance engineering really becomes Tor-specific. A few examples:

    - Making assets embedded as base64 (img src the header logo as base64, all CSS should be inline, etc.).

    - Leveraging CSS as much as possible (if you use animations and transitions, use CSS as much as possible for these, avoid JS for them).

    - Make sure your website is mostly rendered on the backend. If you're to have JS, your website should work without it.

    - Security becomes REALLY fun, as in, avoid XSS, CSRF, SQL Injection attacks and any other injections as much as possible.

    As someone summarizes in another comment[0], keep the chattiness as minimal as possible. By chattiness I understand they mean, pack as much data as you can in the same Keep-Alive connection. Avoid making new HTTP requests as much as possible, as each one might get assigned to a new Onion route making things slow.

    If you can ship your website to the browser in a single connection, you've won.

    I've always been impressed by performance of these big Onion sites, they really push the limits of software engineering creativity, given these constraints and nature of Tor.

    --

    [0]: https://news.ycombinator.com/item?id=49872320

    EDIT: Formatting of bullet points.

    • orbital-decay 5 hours ago

      Also DDoS becomes a problem, and the ways it's done are pretty specific to Tor. Double captchas are necessary when you're getting DDoSed, due to performance reasons. Oh, and captchas are also pretty specific to Tor as well.

      There's also a problem of site fronting. Anyone could run a proxy pretending to be you, for arbitrary reasons (not even necessarily the obvious forging and credential stealing). Every site, even a personal blog, has dozens of parasitic fronts, either actively malicious or dormant. You need off-site ways to tell users what is the real address, and provide a smoke test for them (often a part of the address as a picture, for example in a captcha).

      >avoid JS for them

      Using any JS defies the point and makes your site instantly suspicious.

      • Lucasoato 2 hours ago

        > There's also a problem of site fronting. Anyone could run a proxy pretending to be you, for arbitrary reasons (not even necessarily the obvious forging and credential stealing). Every site, even a personal blog, has dozens of parasitic fronts, either actively malicious or dormant. You need off-site ways to tell users what is the real address, and provide a smoke test for them (often a part of the address as a picture, for example in a captcha).

        How can you do this without relying on the normal web? Let’s say you use a normal website to show the onion link, if the website gets taken down, you lost your user-trusted mean to do that.

        • someonebaggy 2 hours ago

          Your users should have bookmarked it

          • Lucasoato 2 hours ago

            What about new users?

            • someonebaggy 2 hours ago

              How did they learn about the site? There's nothing you can do to stop your competitor advertising their own identical site in the same way you did - a malicious proxy is just a special case of this principle.

              • Lucasoato 2 hours ago

                I’m thinking about blockchain provided onion URLs, but maybe I’m fantasizing a bit too much.

                • orbital-decay an hour ago

                  It's not an easy problem due to mutually exclusive constraints, look at Yggdrasil and adjacent decentralized DNS tech as an example of thinking in that direction.

                • someonebaggy an hour ago

                  Zooko's Triangle

        • orbital-decay an hour ago

          >How can you do this without relying on the normal web?

          How can you trust anything you haven't experienced personally? By using chains of trust, of course. There are directories that list onion sites, and also sites that link to their peers. That way you can be sure you're still in the same bubble at least, and convert the problem into trusting the entire bubble. It's not automated and pretty ad hoc, if that's what you're wondering. Automation in Tor has a history of being circumvented or exploited with novel scams, this is an adversarial environment.

      • dalvrosa 4 hours ago

        How are captchas done?

        • ulrikrasmussen 3 hours ago

          A combination of different ones, sometimes close to what you know from the clearnet, i.e. click pictures that match a description. For the proxy defeating one, the server can send you a picture of the real .onion address where some letters are blanked out, and with noise added to it to prevent it from being solved by the proxy. You then have to enter the blanked out letters from the browser URL.

          This can of course still be defeated if the proxy URL receives very few requests and just have a human in the middle to solve the CAPTCHAs. But it does make the attack non-automated.

    • boredatoms 9 hours ago

      Are these simply good ideas regardless of tor?

      • nephanth 4 hours ago

        Depends on which ones. Embedding assets as base64 makes little sense nowadays with http pipelining.

        Relyinging the least possible on js, and using CSS for animations sounds like good engineering to me

      • ivanmontillam 9 hours ago

        With CDNs of today, they are not so much relevant for the clearnet.

      • geraldhh 3 hours ago

        Yes, but

      • Gigachad 3 hours ago

        Not really. The latency between a client and clearnet sites is tiny, and splitting assets in to separate resources makes caching work better.

        • boomlinde 2 hours ago

          Minimizing latency and connection count is only half of the problem, though. To the greatest extent possible not relying on JavaScript, and to the greatest extent possible not relying on third party libraries when you do seems like a good general takeaway.

        • someonebaggy 2 hours ago

          Some people live in Australia though

  • basilikum 12 hours ago

    You probably want to add the Onion-Location header to the clearnet site so Tor Browser can automatically inform the visitor about it: https://community.torproject.org/onion-services/advanced/oni...

  • mzajc 11 hours ago

    Besides using a separate port, I would also suggest running the hidden service on a non-127.0.0.1 bind address, just in case you ever host something else on that port and forget to disable the hidden service:

    > HiddenServicePort 80 127.13.37.1:8080

    > listen 127.13.37.1:8080;

    This way, strangers won't be able to connect to a service bound to 127.0.0.1, should you ever decide to re-use the port and forget to disable the hidden service.

    You'll also need to use separate ports and/or bind addresses if you host multiple hidden services and don't want people to correlate them - if nginx doesn't match the Host header, it will serve whichever site comes first alphabetically.

    • someonebaggy 11 hours ago

      It's also possible to use a Unix socket, which can have a descriptive pathname like /var/run/my-service.sock: https://stackoverflow.com/questions/69313114/using-nginx-to-...

      • jeroenhd 3 hours ago

        Every time I've tried using Unix sockets, I've run into the problem as described in your stackoverflow link. The suggested solution ("just run tor as root") is not exactly best practice.

        You can monkey-patch scripts around Tor service activation, but I haven't been able to get my Tor+nginx setup to work reliably after updates/service restarts when using unix sockets.

      • m00dy 6 hours ago

        using unix socket rather than tcp has advantages

        • BonerWiener 6 hours ago

          Can you elaborate?

          • Tepix 5 hours ago

            For starters, it’s twice as fast

            • someonebaggy 4 hours ago

              AFAIK TCP outperforms Unix sockets for some odd reason, but it's irrelevant anyway because you aren't getting that much bandwidth through Tor.

  • hoistway 26 minutes ago

    Adds a whole new layer of paranoia, but for some things, it's probably the only way to genuinely stay off the grid.

  • coldblues 2 hours ago

    I recommend that people give I2P and Yggdrasil a try as well, especially Yggdrasil. It makes no compromises on speed and latency, but it has no anonymity.

  • dherls 12 hours ago

    What is the benefit of building the same website twice with different hostnames instead of using relative links to content on the same domain?

    • dalvrosa 12 hours ago

      Fair point. Very small things like RSS, canonical link or og:url or microformats use absolute URL

      To make sure once in the .onion, you never leave the .onion

    • xena 5 hours ago

      Website impersonation/fronting is a big problem in onionland, this at least makes fronters need to take more effort.

  • comrade1234 12 hours ago

    Besides accessing your page are random people able to use your server as an exit node? Am I thinking the right thing... I met someone in Switzerland that was hosting anonymous exit nodes to some anonymous network and he said that it was a pain having to explain what was happening to the police.

    • creatonez 11 hours ago

      Exit node are an entirely optional part of the Tor network. If you run a relay or a hidden service you are not forced to participate in the exit node side of things. It's also not recommended to combine these roles because it could have security implications for your hidden service.

    • fishgoesblub 12 hours ago

      Running a Tor exit node is a manual process. Running a hidden service like a website, or chat server doesn't involve anything like that.

    • someonebaggy 4 hours ago

      You can't accidentally run an exit node.

    • dalvrosa 12 hours ago

      That'd be an exit relay, not doing that atm, just in case

    • basilikum 12 hours ago

      No

  • sermah 4 hours ago

    > so that no single party can link who you are to what you are doing

    some single parties called government agencies pretty much can. it’s just much harder to do, so you’re safe from random people

    • merpkz an hour ago

      we have been hearing this all the time whenever Dark Web is being discussed, but fact of the matter is that all the big darknet market busts have been done in past because of sloppy opsec by their operators and not some magical government wand which can pinpoint location of a hidden service

  • jan_m_savage 3 hours ago

    absolutely love how OP's site is designed. It's clean and minimal, fast and user-friendly, but also stylish.

    • FinnKuhn 12 minutes ago

      It reminded me of a simpler version of https://gwern.net/.

    • grvdrm 21 minutes ago

      Agree completely. First thing that stands out about it: unique design. I immediately enjoy looking at it.

    • trymas 2 hours ago

      Indeed. Also interesting to mouse hover on the avatar in the home page: https://david.alvarezrosa.com

      • jan_m_savage an hour ago

        yes, interesting enough, I also did hover and when it rolled i chuckled... like a head rolling... =LOL.

  • dalvrosa 12 hours ago

    Thanks for sharing! Happy to get feedback :)

  • charcircuit 10 hours ago

    A few more tips.

    1. If you want to improve page load speed you need to buy a HTTPS certificate so you are not limited to HTTP/1.1. Multiplexing in HTTP/2 is important for getting sites to load fast.

    2. You can set the HiddenServiceExportCircuitID configuration to pass the circuit id to your web server for telemetry or anti abuse purposes. Otherwise your logs will say that all users are coming from the same IP.

    https://blog.cloudflare.com/cloudflare-onion-service

    • markasoftware 9 hours ago

      Fascinating, onion services are always encrypted by the tor network but still tunnel "cleartext" http inside that, and there are no CAs that issue free of charge certificates for .onion domains, and therefore there's no free of charge way to get http/2 on onion services without self signing.

      Which raises the question: why not just trust self-signed certificates on onion services? From my brief look it seems to be because the Tor project views the primary purposes of HTTPS on onion services to be other things rather than just http/2 support: http/2 isn't even mentioned on their page about https for onion services (https://community.torproject.org/onion-services/advanced/htt...). Unfortunate.

      • someonebaggy 2 hours ago

        Negotiating HTTP 2 requires an extra round trip btw. It gets absorbed into the several round trips required for TLS.

        • charcircuit an hour ago

          Despite that my benchmark was faster with HTTP 2.

      • charcircuit 8 hours ago

        I personally would support automatically trusting self signed https certs since their key is typically secured under the same safety as the hidden service's key. And even when they are not the browser has no warning when you get downgraded to HTTP on an onion compared to a regular site.

        Trying to push hidden services to stay on HTTP is going against what the rest of the web is doing and as a minority of web traffic it really should be aligned to the rest of the web and also require HTTPS. Yes, it's technically wasteful, but reduces both work and security risk by keeping security models aligned with the rest of the web.

        • littlecranky67 5 hours ago

          And it breaks Javascript as a lot of APIs only work when the site is served via HTTP - which .onion sites won't be usually. Tor browser treats .onion sites as secure content, but not your regular browser using TOR via proxy.

        • someonebaggy 4 hours ago

          Who would issue the certificates?

          • markasoftware 3 hours ago

            The "self" in "self-signed" means "you"

            • someonebaggy 2 hours ago

              There's no point teaching the browser that self signed certificates are secure instead of teaching the browser that onion addresses are secure.

    • Cider9986 9 hours ago

      Can you buy one of these in XMR?

  • superkuh 8 hours ago

    The one thing I learned from hosting superkuhbitj6tul.onion (from a home computer) for ham radio and science stuff for about a decade was that EVERYTHING ON A .ONION IS EPHEMERAL. When the tor project correctly decided that for high security torv2 no longer was anonymous enough they unilaterally wiped out every torv2 .onion site that existed. Every link that was made between these sites came to an end in 2021 when they released a tor client without support for torv2 onions and tore the web to pieces.

    Know this: the "dark web" is not for people who just want to own your domain name. It's for SECURITY and that use case is going to drive all their decisions. And if it wipes out every community in the entire tor dark web? So be it. And they'll do it again. Don't build your communities on the sand that is the dark web. You won't like the result.

    • brnt 7 hours ago

      Don't tie anything to a domain name you mean. Advice that's just as valid for clearnet.

      v2 onions being deprecated was announced long in advance so many sites managed their transfer by announced the new URL well in advance. I don't think anyone was really bothered.

    • h0p3 7 hours ago

      You're not wrong about significant brittleness and lack of sovereignty (and the same should be said about the web, too, roughly speaking), but I don't think your prescription is correct. Thus far, my only solution has been to maintain a variety of gateways to the same signed object which itself provides the evolving list of connection gateways. Gotta stay ahead of the whackamole through diversity, imho. I've found my i2p and tor identities have actually been some of the longest lasting, especially compared to non-bigcorpo clearnet web hosts. That's definitely not how most people want to use the net, ofc, but it's probably the right kind of practice that we should collectively be engaged in together if we want communities that actually own the means of production about as far as we reasonably can atm. And, these days, LLMs make this process much, much easier, too, as rediscovery and rebuilding custom infra per individual or community is far more doable for the average person (if they really wanted to do it, and I'm not claiming they would*).

  • nonasking_ 5 hours ago

    No DNS, no CA, no exposed IP. Just a ridiculously long string of characters and a bit of determination.

  • shevy-java 4 hours ago

    I like the idea of TOR, but whenever I used it, I hit a speed penalty.

    This, in turn, handicaps me searching for information. If they could fix this problem then I would be more likely to make use of TOR. We really need to think long-term about a future web that isn't ruined by Google etc... while also not being locked down such as via age-gating.

    • jeroenhd 2 hours ago

      I think it must depend on how far away you are from a gateway into the Tor network. There's a slight delay for getting the network ready when I start Tor on my devices, but after that it's not so bad.

      Tor amplifies the problems caused by badly written websites that do a billion HTTP calls (unless you have HTTPS enabled on Tor) which does make it noticeably slower in a few edge cases, but I don't think it's as bad as its reputation suggests. For this particular blog, the Tor version loads maybe a couple hundred milliseconds slower, mostly because of images coming in slower (content is ready almost immediately).

      Lots of hidden services seem to be under constant DDoS attack, though.

      There are still plenty of issues with TOR (my main gripe is the "domain names" being practically impossible to recognize/trust or tell anyone about in the real world), but I don't think speed is the biggest factor anymore.

    • dalvrosa 4 hours ago

      Agreed, it can be quite painful

  • 6510 11 hours ago

    Imagine if normal people could install a single normal application and just run a website from a folder. CLI makes it more difficult than hosting a normal website. Typing commands you don't understand doesn't seem all that of a great idea.

    • jeroenhd 2 hours ago

      https://docs.onionshare.org/2.6.5/en/features.html#host-a-we...

      Onionshare runs on basically every device out there (for obscure devices like Linux ARM phones you may need to compile it manually). Install the app, point it at a directory with an index.html file inside, and you're done.

    • someonebaggy 2 hours ago

      Used to work like this when you had only one computer on an internet connection. With ipv6 it could be a reality once again.

    • brnt 7 hours ago
    • bitfilped 9 hours ago

      If you don't understand what a command does, go learn it.

      • paulryanrogers 8 hours ago

        For us that's fine. It's quite a hill to climb for non technical folks. Even AIs holding their hand will have to do a lot of explaining.

  • hn9zmdcaou 12 hours ago

    Nice thing is you skip port forwarding entirely, which matters a lot if your ISP has you behind CGNAT. Curious how people handle uptime though, since a hidden service going down isn't something you notice until someone tells you.

  • han1 10 hours ago

    My open source project (https://github.com/du82/nonograph) spawns a Tor hidden service with Onion-Location advertising by default, and on the Docker container its always on and self-healing

  • hndhyc0bdt 12 hours ago

    Ran a small onion site for a couple years and the nice part is you never touch a public IP or a cert. Downside is onion v3 addresses are impossible to share verbally and the latency makes anything chatty feel broken. Static pages only, honestly.

    • someonebaggy 10 hours ago

      You have to keep chattiness low, but a lot of SSR stuff works fine. Dread uses SSR, and even nags you if you have JavaScript enabled.