Robots.txt

User avatar
broncosman
Posts: 3
Joined: 09 Jan 2016, 12:37

Robots.txt

Postby broncosman » 10 Jan 2016, 07:18

I've been looking to read some old Desteni articles archived on the WayBack Machine,but I see that you have used robots.txt to disable archiving of the Desteni website. Why is that? :( There's some pretty interesting stuff in there,it would be nice if you could re-enable it.



User avatar
barbara
Posts: 622
Joined: 12 Jun 2011, 21:52

Re: Robots.txt

Postby barbara » 10 Jan 2016, 12:49

Hi Broncosman,

The same articles are on the current website - under the ‘Articles’ tab: http://desteni.org/articles

Would you like to introduce yourself? How did you come across Desteni? What is most interesting to you from the material?

Also suggested to check out https://eqafe.com, our online recording and interviews shop. You can find a huge offer of free articles there too, as well as bulk packages and you can even have your very own personal interview done by/through the Portal.

Hope to see you around!



User avatar
broncosman
Posts: 3
Joined: 09 Jan 2016, 12:37

Re: Robots.txt

Postby broncosman » 11 Jan 2016, 01:44

Ok,I looked and unfortunately,the postings I'm looking for aren't there. They are related to two youtubers I enjoyed watching,Ben1607 and Jonathan Adampants. I was introduced to Desteni by Ben1607 and then later on I learned that Adampants was also involved with it. I had been able to view these postings before,but now they are gone because of the robots.txt.



User avatar
broncosman
Posts: 3
Joined: 09 Jan 2016, 12:37

Re: Robots.txt

Postby broncosman » 12 Jan 2016, 08:24

I see that you have removed the robots.txt and now I am able to access the postings again. Thank you very much,I really appreciate it :D




Return to “Introduce Yourself”

Who is online

Users browsing this forum: No registered users and 1 guest

cron