Robots.txt

Post Reply
User avatar
broncosman
Posts: 3
Joined: 09 Jan 2016, 12:37

Robots.txt

Post by broncosman »

I've been looking to read some old Desteni articles archived on the WayBack Machine,but I see that you have used robots.txt to disable archiving of the Desteni website. Why is that? :( There's some pretty interesting stuff in there,it would be nice if you could re-enable it.
User avatar
barbara
Posts: 622
Joined: 12 Jun 2011, 21:52

Re: Robots.txt

Post by barbara »

Hi Broncosman,

The same articles are on the current website - under the ‘Articles’ tab: http://desteni.org/articles

Would you like to introduce yourself? How did you come across Desteni? What is most interesting to you from the material?

Also suggested to check out https://eqafe.com, our online recording and interviews shop. You can find a huge offer of free articles there too, as well as bulk packages and you can even have your very own personal interview done by/through the Portal.

Hope to see you around!
User avatar
broncosman
Posts: 3
Joined: 09 Jan 2016, 12:37

Re: Robots.txt

Post by broncosman »

Ok,I looked and unfortunately,the postings I'm looking for aren't there. They are related to two youtubers I enjoyed watching,Ben1607 and Jonathan Adampants. I was introduced to Desteni by Ben1607 and then later on I learned that Adampants was also involved with it. I had been able to view these postings before,but now they are gone because of the robots.txt.
User avatar
broncosman
Posts: 3
Joined: 09 Jan 2016, 12:37

Re: Robots.txt

Post by broncosman »

I see that you have removed the robots.txt and now I am able to access the postings again. Thank you very much,I really appreciate it :D
Post Reply

Return to “Introduce Yourself”