Jeff Taylor | 1 Jun 05:32 2011
Picon

Re: [opennic-discuss] New search engine being populated

I have replaced the old search engine with the new code.  While the database is 
still being populated, it already contains a larger number of indexed pages than 
the original engine.  At this time I cannot give any estimate of the timeframe 
for completion of the initial indexing, but I have three servers checking 
OpenNic and NewNations websites 24 hours a day.

Please be aware that many search results are currently not showing a 
description... These are pages which have been discovered (and probably showed 
up in your search because of a match in the URL), but these pages have not been 
indexed yet, so the content is unknown.  As the page indexing progresses, more 
information will be filled in.

New search engine: http://grep.geek/

Original search engine: http://grep.geek/orig/

_______________________________________________
discuss mailing list
discuss <at> lists.opennicproject.org
http://lists.darkdna.net/mailman/listinfo/discuss

Alex Hanselka | 1 Jun 05:44 2011

Re: [opennic-discuss] New search engine being populated

Awesome! So exciting to have a nice and new search engine :)

On Tue, 31 May 2011 21:32:24 -0600, Jeff Taylor wrote:
> I have replaced the old search engine with the new code.  While the
> database is still being populated, it already contains a larger 
> number
> of indexed pages than the original engine.  At this time I cannot 
> give
> any estimate of the timeframe for completion of the initial indexing,
> but I have three servers checking OpenNic and NewNations websites 24
> hours a day.
>
> Please be aware that many search results are currently not showing a
> description... These are pages which have been discovered (and
> probably showed up in your search because of a match in the URL), but
> these pages have not been indexed yet, so the content is unknown.  As
> the page indexing progresses, more information will be filled in.
>
> New search engine: http://grep.geek/
>
> Original search engine: http://grep.geek/orig/
>
> _______________________________________________
> discuss mailing list
> discuss <at> lists.opennicproject.org
> http://lists.darkdna.net/mailman/listinfo/discuss

_______________________________________________
discuss mailing list
discuss <at> lists.opennicproject.org
(Continue reading)

Alex Hanselka | 1 Jun 08:42 2011

Re: [opennic-discuss] Alternative DNS port available on public server

So you have to use firewall rules to use a DNS server on a different port? 

Sorry if I am just dumb :)

On Sun, May 29, 2011 at 10:55:28PM -0400, Zach Gibbens wrote:
> I wanted to mention that 2 other servers run on 5353, according to a
> march email (for a current total, to my knowledge, of 3 servers)
> and those same iptables rules work on a rooted android smartphone with
> iptables support.
> 
> Also, I think I can get a set of ipfw rules for apple and *bsd
> systems, however, I cannot test it on a mac personally, I'll be on the
> latest FreeBSD.
> Still unsure of how to apply this to Windows, all I can say is stay tuned.
> 
> Slightly Unrelated note, Things are starting to work in my favor
> again, with this I should have a server running shortly, listening on
> 53 & 5353, and I'll be working towards another method for this,
> primarily for those lacking administrative rights to use this method,
> or windows (at least until I can get a smoother solution for windows)
> Glad to be able to help OpenNIC again.
> 
> On Mon, May 9, 2011 at 2:03 AM, Zach Gibbens <infocop411 <at> gmail.com> wrote:
> > I have tested this with Jeff tonight, I only have IPv4 access tonight,
> > but I presume substituting one address for the other will work. For a
> > Linux machine with iptables, run two commands
> >
> > sudo iptables -t nat -A OUTPUT -p udp --dport 53 -j DNAT --to 216.87.84.211:5353
> > sudo iptables -t nat -A OUTPUT -p tcp --dport 53 -j DNAT --to 216.87.84.211:5353
> >
(Continue reading)

Jeff Taylor | 2 Jun 06:02 2011
Picon

Re: [opennic-discuss] New search engine being populated

Regarding this issue about labeling content... while I still do not have a 
solution for determining if a page is unique to OpenNic, or simply a mirror of 
an ICANN domain, I do have a way to tag contents based on what group it is 
coming from.  I have now added tags to pages based on their source (opennic, 
newnations, icann), and will add additional tags as we peer with other groups.

Once I get some sample data in the database, I will get some buttons added to 
the web page to allow users to limit search results by their source, for those 
who wish to search ONLY within a specific DNS set.  Hopefully this is satisfactory?

On 05/24/2011 11:18 PM, Alex Hanselka wrote:
> It isn't necessarily a problem at all.  I think it's more that some want
> an OpenNIC search engine to find content unique to OpenNIC and label
> mirrors as such.
>
> On Tue, May 24, 2011 at 09:41:19PM -0700, Erik Andersen wrote:
>> I'm no expert or DNS server operator, but...
>>
>> Why wouldn't you want to index domains that are still available over
>> ICANN domains? Because of limited indexing power and that Google
>> probably has already indexed it?
>>
>> If thats your reason, and you decide to truncate results, then you
>> should tell what ICANN domain it is (or even provide a link to search
>> that ICANN domain for the same terms with google).
>>
>> Personally, I run an Apache config that serves both my ICANN domain
>> and my Opennic domain from the same folder. I do this because what
>> would I want to put on my OpenNIC domain that I wouldn't also want to
>> put on my ICANN domain?  I use Opennic because it allows my to have
(Continue reading)

Jeff Taylor | 8 Jun 18:15 2011
Picon

[opennic-discuss] Unexpected outage of the Colorado US servers

I had an overnight crash of one server which took down another server, and 
basically shut down all services for about 6 hours.  DNS services are back up 
again, grep.geek should be back online shortly, and hopefully everything else 
came back up automatically.
_______________________________________________
discuss mailing list
discuss <at> lists.opennicproject.org
http://lists.darkdna.net/mailman/listinfo/discuss

Jeff Taylor | 11 Jun 17:57 2011
Picon

Re: [opennic-discuss] New search engine being populated

Today the new search engine has surpassed 700,000 pages indexed, including both 
OpenNic and NewNations domains.  I have seen some interesting content in the 
logs, including several wikileaks mirrors, a wikipedia mirror, and some 
extensive sites devoted to TV shows and mystery novels.

When you perform a search, you may still find some results without 
descriptions.  These are simply pages which are known to the search engine, but 
not yet indexed, and the content will be indexed eventually.  Also of note, I 
have added buttons to the left side which allow you to restrict your search 
within a specific root system (opennic, newnations, icann).
_______________________________________________
discuss mailing list
discuss <at> lists.opennicproject.org
http://lists.darkdna.net/mailman/listinfo/discuss

Julian DeMarchi | 14 Jun 00:54 2011
Picon

[opennic-discuss] [NS0] Extended downtime

heya--

this is a notice to inform all ns0 is currently having some slight
issues. I am currently working on the issue's and will report back when
it is fixed.

--julian
_______________________________________________
discuss mailing list
discuss <at> lists.opennicproject.org
http://lists.darkdna.net/mailman/listinfo/discuss

Julian DeMarchi | 14 Jun 01:17 2011
Picon

Re: [opennic-discuss] [NS0] Extended downtime

On 06/14/2011 08:54 AM, Julian DeMarchi wrote:
> heya--
> 
> this is a notice to inform all ns0 is currently having some slight
> issues. I am currently working on the issue's and will report back when
> it is fixed.

All is ok now.

Sorry for this.

--julian
_______________________________________________
discuss mailing list
discuss <at> lists.opennicproject.org
http://lists.darkdna.net/mailman/listinfo/discuss

Zach Gibbens | 15 Jun 10:09 2011
Picon

Re: [opennic-discuss] [NS0] Extended downtime

On 06/13/2011 07:17 PM, Julian DeMarchi wrote:
> On 06/14/2011 08:54 AM, Julian DeMarchi wrote:
>> heya--
>>
>> this is a notice to inform all ns0 is currently having some slight
>> issues. I am currently working on the issue's and will report back when
>> it is fixed.
> All is ok now.
>
> Sorry for this.
>
> --julian
> _______________________________________________
> discuss mailing list
> discuss <at> lists.opennicproject.org
> http://lists.darkdna.net/mailman/listinfo/discuss
Downtime happens, from a users perspective, I didn't notice anything 
off, which is always good.
_______________________________________________
discuss mailing list
discuss <at> lists.opennicproject.org
http://lists.darkdna.net/mailman/listinfo/discuss

mike | 20 Jun 02:11 2011

[opennic-discuss] Sharp increase in DNS traffic.


Any other ops noticing a sharp increase in DNS traffic since late
yesterday or so?

I don't keep any logs, so I can't give a detailed report, but 'named'
CPU usage has climbed significantly along with UDP traffic on port 53.

I'm just trying to estimate if this is a trend or if this is a once-time
event of some sort. If it's a trend then I probably need to start
budgeting for some hardware upgrades at some point, my DNS is running
only on a single core, 32-bit 2GHz CPU  <at>  1.5 GB RAM. I've got plenty of
RAM, but 'named' since perhaps around midnight last night has the CPU
pegged at 45-55%.

--Mike


Gmane