haiku-files.org domain expired

[pulkomandy]

It is not possible to reach www.haiku-files.org anymore.

It is still used to host a few archives used by haikuports, as well as some "optional packages" used by Haiku build system (mainly the "demo packages" containing a variety of emails, people files, videos, images and sounds).

Even if we decide to not bring it back, I don't know the dreamhost server name it is currently hosted at, so I can't access the files at all (even using ssh). We could point another domain to it (files.haiku-os.org?) or, if we don't want to use it anymore, I would like to make a backup of the stuff that's in there before it is gone :(

[waddlesplash]

I asked kallisti5 about this and he seemed to think they let it expire on purpose? That seems like a strange decision to me, I don't see anywhere that it was decided upon. I don't think we should have let that happen.

Anyway, he did look around for credentials to DreamHost and could not find any, or at least the account that he knows of's email goes to a contributor who isn't around anymore.

I vaguely recall humdinger having access to upload things?

[waddlesplash]

Hmm, the domain looks to be registered by NameCheap and still has a Registry Expiry Date in the future. Are we sure we don't control it actually, and it's just in the auto-renew period somehow?

[pulkomandy]

I had access to upload things by ssh. But I did that using the domain to connect to the right Dreamhost server (their hosting distributes websites to various servers, and occasionally moves them around).

Since there is no domain anymore, I don't know where to connect to. According to dreamhost documentations, the server name (something.dreamhost.com) would be found in the web interface. If I had that, I could connect to it. But if no one has access to that web interface, there's no way to recover that?

[kallisti5]

So, haiku-files.org was one of the domains that had auto-renewals fail.

Either myself or Ryan just let it expire and didn't fix it when we had all the lovely random auto-renewal failures at Namecheap. Nothing (that we knew of) was still hosted there.

The domain is gone.

For full context, nothing core Haiku has pulled anything from haiku-files for at least a decade. The DreamHost account is inaccessible at the moment as they want to validate the owners email (and the email isn't set to any known Haiku, Inc. address.. this was all setup before the majority of the current board members. A lot of the involved folks are gone.)

I searched the haikuports repo, and found the following recipes using haiku-files.org:

Augustin Cavalier 2015-07-02 11:12:32 -0400 13
* f561efbc96 dev-lang/rebol/rebol-2.101.0.5.75.recip
  SOURCE_URI_2="http://ports-space.haiku-files.org/dev-lang/rebol/r3-make.zip"

Augustin Cavalier 2015-07-02 11:12:32 -0400  9
* f561efbc96 dev-util/fastdep/fastdep-0.16.recipe
  SOURCE_URI="http://ports-space.haiku-files.org/dev-util/source/fastdep-0.16.tar.gz"

Augustin Cavalier 2015-07-02 11:12:32 -0400 11
* f561efbc96 haiku-apps/recibe/recibe-1.0b1.recipe
  SOURCE_URI_2="http://ports-space.haiku-files.org/recibe/recipes.db.zip#noarchive"

Humdinger         2015-08-31 17:16:33 +0200  9
* ae698c8c3b media-libs/sge/sge-030809.recipe
  SOURCE_URI="http://ports-space.haiku-files.org/source/sge-030809.tar.gz"

Augustin Cavalier 2015-07-02 11:12:32 -0400 13
* f561efbc96 media-fonts/droid/droid-4.3_r2.2.recipe
  SOURCE_URI="http://ports-space.haiku-files.org/media-fonts/source/droid-4.3_r2.2.zip"

Jerome Duval      2018-08-06 14:25:37 +0200 12
* 9a6fd9b28c media-fonts/droid/droid-113.recipe
  SOURCE_URI="http://ports-space.haiku-files.org/media-fonts/source/droid-113.tar.gz"

Jerome Duval     2022-05-19 16:04:25 +0200  9
* 0444679b02 haiku-data/be_book/be_book-2008_10_26.recipe
  SOURCE_URI="http://haiku-files.org/files/data/bebook_20081026.zip#noarchive"

PulkoMandy       2022-12-29 21:40:52 +0100 11
* 88b9c81385 sys-devel/jamfile_engine/jamfile_engine-1.0.3.recipe
  SOURCE_URI="http://www.haiku-files.org/files/jamfile_engine-1.0.3.zip"

PulkoMandy       2023-08-08 21:46:14 +0200  7
* 3fc4bbc23b media-fonts/noto_emoji/noto_emoji-20230311.recipe
  SOURCE_URI="http://www.haiku-files.org/files/Noto_Emoji.zip"

Are these the individuals with access keys to the previous haiku-files?

To summarize:

• We had no idea anyone still had access to Dreamhost and was still actively uploading anything to it
• We let a 15 year old domain that has been unused (that anyone knew of) for the last 10 years expire

We moved away from DreamHost because while they were awesome to provide services at no cost in the mid-late 2000's, we were beginning to abuse their generosity and started to consume too many resources.

[kallisti5]

Also, I assume these files are still on our dreamhost account.. we just need to figure out who's email is getting the 2fa emails to login.

[pulkomandy]

Well, yes, it was maybe time to retire it, but still, it would have been nice to know a few days before it was gone and have a chance of making a backup of all the stuff hosted there, even if it's not relevant for current Haiku developments...

I'm happy to copy these things over to beosarchive or we can ask archive.org as well.

The missing haikuports download are not so much a concern, I think, we can rebuild these files or find copies somewhere (maybe in the haikuports builders if they keep the downloads when building things?).

Anyway, I looked up the data for the domain (there are thankfully some DNS services out there: ​https://dnshistory.org/historical-dns-records/a/www.haiku-files.org) and found the IP for the server, so you can access it at (if your keys are added on the server):

ssh haiku_files@69.163.186.98 or haiku_files@…

I will try to make a backup of it all (it's about 14GB of stuff apparently).

[pulkomandy]

Here you go, it's now available at ​https://pulkomandy.tk/~beosarchive/unsorted/haiku-files.org/

However, please don't point everyone there, it's hosted on an old laptop in my living room which isn't the best way to go about these things.

[kallisti5]

it would have been nice to know a few days before it was gone and have a chance of making a backup of all the stuff hosted there

That's fair. To be honest if I remember correctly, haiku-os.org was also expiring at the same time due to the renewal failures (which kinda distracted me, and was a *major* issue at the time)

If you're looking to reduce, there's likely little need for any nightly images (which probably consume a lot of space)

I'll scour the sources and haikuports and redistribute things. If we need to upload stuff somewhere, I can toss it into our official s3 buckets since they cost pretty much nothing to maintain.

[kallisti5]

Looking over the Haiku source repo, here's what's left that references haiku-files:

No concern:
3rdparty/mmu_man/scripts/bootstrap-haiku.sh:	tf=/tmp/haiku-files.org_raw_$$
3rdparty/mmu_man/scripts/bootstrap-haiku.sh:	wget -O $tf http://haiku-files.org/raw/ >/dev/null 2>&1 || error "wget error"
docs/develop/packages/OldIdeas.rst:   http://lists.ports.haiku-files.org/pipermail/
docs/develop/packages/OldIdeas.rst:   haikuports-devs-ports.haiku-files.org/2009-June/000516.html



Probably needs investigated:
3rdparty/vmware/haiku-alpha.vmx:# http://haiku-files.org/files/blank-bfs/blank-bfs-2048mb.vmdk
3rdparty/vmware/haiku-nightly.vmx:# http://haiku-files.org/files/blank-bfs/blank-bfs-2048mb.vmdk
docs/develop/packages/Migration.rst:    that has to be done manually on the haiku-files.org server. The process will
docs/develop/release/milestones.rst:* rsync release-files-directory to http://haiku-files.org/files/releases/[release-name]

[kallisti5]

I moved jamfile-engine here: ​https://github.com/HaikuArchives/jamfile-engine/releases/tag/1.0.3. Updating haikuports url

[kallisti5]

​http://haiku-files.org/files/data/bebook_20081026.zip#noarchive was moved to a Haiku, Inc. controlled s3 bucket. (and haikuports recipe updated)

[leavengood]

I have the DreamHost login details, the email is Axel's: axeld@…

I tried to log in but it sent an email there because of a "new location"

@axeld do you still have access to that email?

Though maybe it does not matter if pulkomandy already got the data off it.

[pulkomandy]

Would it be possible to reconfigure it and have files.haiku-os.org point to it? Or is the plan to close it and save a little money by not paying dreamhost anymore?

[pulkomandy]

We have some dead links to video tutorials and other things on the website. I tried reuploading the videos to haiku-os.org, but github has a limit of 100MB on uploaded files, and some of the videos are larger than that.

What are our options for hosting such files at Haiku? Besides the videos, there are also some historical things such as the preview disk image for package management, and quite a lot of other things. So it would be nice to restore access to it in some way (on a new domain, since haiku-files.org is now domain squatted).

What would be the plan for that? Dreamhost is/was working fine, and, if I understand the news announcement from back when haiku-files was created, they provide the hosting for free? It's a bit sad to let such partnerships go to waste?

[leavengood]

Yes, it is a free account Dreamhost gave us. I just tried to log in again and got the same message about a new location and that it was emailing Axel. I then emailed the same address to see if it was still active, and I have not yet gotten a bounceback so I assume it is active. I asked Axel to forward the email, if we can get in to the account hopefully we can change the email address they have on the account.

[waddlesplash]

It's a bit sad to let such partnerships go to waste?

Perhaps we could point files.haiku-os.org to DreamHost?

[waddlesplash]

Ah, I see PulkoMandy suggested the same already. Well, that makes sense to me at least.