YaCy Release 1.02

Release 1.02

Major Changes   
Jump to: Bugfixes / Other Changes

CommitDescription
Wed Feb 22 12:21:27 CET 2012
by Michael Peter Christen
added changes from copperdust (submitted by email):
1. Improved and fixed language detection:
	1.1 Identificator.java - recognition fix (improved)
	1.2 DCEntry.java - fix (changed detection order due to detection from
tld in many cases is incorrect)
	1.3 MultiProtocolURI.java - fixed and enhanced language from tld
detection (all currently used top-level domains; ccTLD added but not
tested).
2. Ukrainian language update.
3. Main Slavic languages langstats (tested and works fine).
Changed Files: langstats/be.lng, langstats/bg.lng, langstats/mk.lng, langstats/ru.lng, langstats/sr.lng, langstats/uk.lng, locales/uk.lng, source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/document/content/DCEntry.java, source/net/yacy/document/language/Identificator.java
Thu Feb 02 21:33:42 CET 2012
by Michael Peter Christen
complete redesign of crawl queue monitoring: do not look at a
ready-prepared crawl list but at the stacks of the domains that are
stored for balanced crawling. This affects also the balancer since that
does not need to prepare the pre-selected crawl list for monitoring. As
a effect:
- it is no more possible to see the correct order of next to-be-crawled
links, since that depends on the actual state of the balancer stack the
next time another url is requested for loading
- the balancer works better since the next url can be selected according
to the current situation and not according to a pre-selected order.
Changed Files: htroot/Crawler_p.html, htroot/IndexCreateQueues_p.html, htroot/IndexCreateQueues_p.java, htroot/api/status_p.java, htroot/api/status_p.xml, htroot/env/grafics/trash.gif, htroot/env/templates/submenuCrawlMonitor.template, htroot/js/Crawler.js, htroot/yacy/urls.java, source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/CrawlStacker.java, source/de/anomic/crawler/Latency.java, source/de/anomic/crawler/NoticedURL.java, source/de/anomic/http/client/Cache.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/search/Switchboard.java
Wed Feb 01 22:26:19 CET 2012
by Michael Peter Christen
tried to fix the ipv6 problem as reported in bug

but this did not solve all problems because a bug in the apache http
client prevented that it worked. Thread dump:
Caused by: java.lang.NumberFormatException: For input string:
"1450:400c:c01:0:0:0:69"
	at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
	at java.lang.Integer.parseInt(Integer.java:458)
	at java.lang.Integer.parseInt(Integer.java:499)
	at org.apache.http.client.utils.URIUtils.extractHost(URIUtils.java:310)
	at
org.apache.http.impl.client.AbstractHttpClient.determineTarget(AbstractHttpClient.java:764)
	at
org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754)
	at net.yacy.cora.protocol.http.HTTPClient.execute(HTTPClient.java:597)
	at
net.yacy.cora.protocol.http.HTTPClient.getContentBytes(HTTPClient.java:558)
	at net.yacy.cora.protocol.http.HTTPClient.GETbytes(HTTPClient.java:341)
	at de.anomic.crawler.retrieval.HTTPLoader.load(HTTPLoader.java:131)
	at de.anomic.crawler.retrieval.HTTPLoader.load(HTTPLoader.java:74)
	at
net.yacy.repository.LoaderDispatcher.loadInternal(LoaderDispatcher.java:274)
	at net.yacy.repository.LoaderDispatcher.load(LoaderDispatcher.java:164)
	at net.yacy.repository.LoaderDispatcher.load(LoaderDispatcher.java:150)
	at
net.yacy.repository.LoaderDispatcher.loadDocument(LoaderDispatcher.java:355)
	at getpageinfo_p.respond(getpageinfo_p.java:97)
	
Changed Files: source/net/yacy/cora/document/MultiProtocolURI.java
Thu Jan 26 22:43:34 CET 2012
by reger
Merge rc1/master
Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/env/base.css, htroot/yacysearch.html, htroot/yacysearch.java, htroot/yacysearchitem.java, htroot/yacysearchtrailer.html, htroot/yacysearchtrailer.java, htroot/yacysearchtrailer.json, source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/NoticedURL.java, source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/SnippetExtractor.java, source/net/yacy/document/WordTokenizer.java, source/net/yacy/document/parser/pdfParser.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/kelondro/order/Digest.java, source/net/yacy/search/SwitchboardConstants.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/ranking/RankingProfile.java, source/net/yacy/search/snippet/MediaSnippet.java, source/net/yacy/search/snippet/TextSnippet.java, vocabularies/de/Freizeitaktivita?ten.vocabulary, vocabularies/de/Freizeitaktivitäten.vocabulary, vocabularies/de/Stadtthemen.vocabulary, vocabularies/readme.txt
Tue Jan 17 01:53:08 CET 2012
by Michael Peter Christen
added the vocabulary navigator. It can be very simply tested by
switching on the locale dictionaries.
Changed Files: htroot/yacy/search.java, htroot/yacysearch.html, htroot/yacysearch.java, htroot/yacysearchtrailer.html, htroot/yacysearchtrailer.java, htroot/yacysearchtrailer.json, htroot/yacysearchtrailer.xml, source/net/yacy/document/Autotagging.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java
Sat Jan 07 00:38:42 CET 2012
by Marek Otahal
!Important: move from Hashtable to HashMap

Hashtable is an obsolete collection v1, now since v2 offers HashMap with same or better
functionality. Please review, almost all code was already moved, so only a few changes. That is not the issue,
but I found notices that some (ugly big) helper classes had to be created in past
to compensate missing Hashtable's functionality. I'd like input if we can remove some of them.
look for //FIX: if these commits

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: source/de/anomic/data/Translator.java, source/de/anomic/http/server/TemplateEngine.java, source/de/anomic/server/serverObjects.java, source/de/anomic/tools/loaderThreads.java, source/net/yacy/document/importer/OAIPMHImporter.java, source/net/yacy/kelondro/util/ByteArray.java, source/net/yacy/kelondro/util/OS.java, source/net/yacy/peers/SeedDB.java, source/net/yacy/search/Switchboard.java
Wed Jan 04 20:32:42 CET 2012
by Michael Christen
Merge commit 'fa08ed5ae5d72bddc3cc6a662b23103579e86109' into quix0r

Conflicts:
	source/de/anomic/crawler/CrawlQueues.java
Changed Files: bin/checkalive.sh, htroot/Banner.java, htroot/ConfigNetwork_p.html, htroot/ConfigNetwork_p.java, htroot/Status.html, htroot/Status.java, htroot/opensearchdescription.xml, htroot/yacysearch.java, skins/28c3.css, source/de/anomic/crawler/CrawlQueues.java, source/net/yacy/kelondro/blob/ArrayStack.java, source/net/yacy/kelondro/data/meta/URIMetadataNode.java, source/net/yacy/peers/Network.java, source/net/yacy/peers/Seed.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/SwitchboardConstants.java, source/net/yacy/search/query/RWIProcess.java
Wed Jan 04 20:16:37 CET 2012
by Michael Christen
Merge commit '6d4e08ed06c5cd28c45981b2ebe31c7f7ec6fd83' into quix0r

Conflicts:
	source/de/anomic/crawler/CrawlQueues.java
Changed Files: htroot/Collage.html, htroot/Collage.java, htroot/IndexCleaner_p.html, htroot/IndexCleaner_p.java, htroot/api/bookmarks/posts/add_p.java, htroot/api/bookmarks/posts/all.java, htroot/api/bookmarks/posts/delete_p.java, htroot/api/bookmarks/posts/get.java, htroot/api/bookmarks/tags/editTag_p.java, htroot/api/bookmarks/tags/getTag.java, htroot/api/bookmarks/xbel/xbel.java, htroot/api/feed.java, htroot/api/getpageinfo_p.java, htroot/api/queues_p.java, htroot/api/ynetSearch.java, htroot/compare_yacy.html, htroot/compare_yacy.java, htroot/processing/domaingraph/applet/domaingraph.java, htroot/processing/domaingraph/applet/index.html, htroot/rssTerminal.html, htroot/terminal_p.html, source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/NoticedURL.java, source/de/anomic/crawler/ResultImages.java, source/de/anomic/crawler/ZURL.java, source/de/anomic/crawler/retrieval/Request.java, source/de/anomic/crawler/retrieval/Response.java, source/net/yacy/ai/example/ConnectFour.java, source/net/yacy/ai/example/testorder.java, source/net/yacy/ai/greedy/AbstractFinding.java, source/net/yacy/ai/greedy/AbstractModel.java, source/net/yacy/ai/greedy/Agent.java, source/net/yacy/ai/greedy/Asset.java, source/net/yacy/ai/greedy/Attempts.java, source/net/yacy/ai/greedy/Battle.java, source/net/yacy/ai/greedy/Challenge.java, source/net/yacy/ai/greedy/Context.java, source/net/yacy/ai/greedy/Engine.java, source/net/yacy/ai/greedy/Finding.java, source/net/yacy/ai/greedy/Goal.java, source/net/yacy/ai/greedy/Model.java, source/net/yacy/ai/greedy/Role.java, source/net/yacy/cora/protocol/RequestHeader.java, source/net/yacy/cora/protocol/ResponseHeader.java, source/net/yacy/kelondro/blob/ArrayStack.java, source/net/yacy/kelondro/blob/Heap.java, source/net/yacy/kelondro/io/Records.java, source/net/yacy/kelondro/table/Relations.java, source/net/yacy/kelondro/util/ISO639.java, source/net/yacy/peers/dht/Dispatcher.java, source/net/yacy/peers/dht/FlatWordPartitionScheme.java, source/net/yacy/peers/dht/PartitionScheme.java, source/net/yacy/peers/dht/PeerSelection.java, source/net/yacy/peers/dht/VerticalWordPartitionScheme.java, source/net/yacy/repository/Blacklist.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/snippet/MediaSnippet.java
Tue Jan 03 17:49:37 CET 2012
by stbrumm
Patch fuer Issue 0000102
and fixes to Patch (private peer status is a property of a peer, not a
status)
Changed Files: htroot/Banner.java, htroot/ConfigNetwork_p.html, htroot/ConfigNetwork_p.java, htroot/Status.html, htroot/Status.java, htroot/yacysearch.java, source/de/anomic/crawler/CrawlQueues.java, source/net/yacy/peers/Network.java, source/net/yacy/peers/Seed.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/SwitchboardConstants.java
Thu Dec 29 00:33:16 CET 2011
by Roland 'Quix0r' Haeder
Fixed a lot CHMOD rights (no need for execute flag on *.java/*.html) and introduced local/remote crawl size ratio based check
Changed Files: htroot/Collage.html, htroot/Collage.java, htroot/IndexCleaner_p.html, htroot/IndexCleaner_p.java, htroot/api/bookmarks/posts/add_p.java, htroot/api/bookmarks/posts/all.java, htroot/api/bookmarks/posts/delete_p.java, htroot/api/bookmarks/posts/get.java, htroot/api/bookmarks/tags/editTag_p.java, htroot/api/bookmarks/tags/getTag.java, htroot/api/bookmarks/xbel/xbel.java, htroot/api/feed.java, htroot/api/getpageinfo_p.java, htroot/api/queues_p.java, htroot/api/ynetSearch.java, htroot/compare_yacy.html, htroot/compare_yacy.java, htroot/processing/domaingraph/applet/domaingraph.java, htroot/processing/domaingraph/applet/index.html, htroot/rssTerminal.html, htroot/terminal_p.html, source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/NoticedURL.java, source/de/anomic/crawler/ResultImages.java, source/de/anomic/crawler/ZURL.java, source/de/anomic/crawler/retrieval/Request.java, source/de/anomic/crawler/retrieval/Response.java, source/net/yacy/ai/example/ConnectFour.java, source/net/yacy/ai/example/testorder.java, source/net/yacy/ai/greedy/AbstractFinding.java, source/net/yacy/ai/greedy/AbstractModel.java, source/net/yacy/ai/greedy/Agent.java, source/net/yacy/ai/greedy/Asset.java, source/net/yacy/ai/greedy/Attempts.java, source/net/yacy/ai/greedy/Battle.java, source/net/yacy/ai/greedy/Challenge.java, source/net/yacy/ai/greedy/Context.java, source/net/yacy/ai/greedy/Engine.java, source/net/yacy/ai/greedy/Finding.java, source/net/yacy/ai/greedy/Goal.java, source/net/yacy/ai/greedy/Model.java, source/net/yacy/ai/greedy/Role.java, source/net/yacy/cora/protocol/RequestHeader.java, source/net/yacy/cora/protocol/ResponseHeader.java, source/net/yacy/kelondro/blob/ArrayStack.java, source/net/yacy/kelondro/blob/Heap.java, source/net/yacy/kelondro/table/Relations.java, source/net/yacy/kelondro/util/ISO639.java, source/net/yacy/peers/dht/Dispatcher.java, source/net/yacy/peers/dht/FlatWordPartitionScheme.java, source/net/yacy/peers/dht/PartitionScheme.java, source/net/yacy/peers/dht/PeerSelection.java, source/net/yacy/peers/dht/VerticalWordPartitionScheme.java
Sun Dec 18 08:12:34 CET 2011
by Michael Peter Christen
more vocabularies and more semantics for lod data structures
Changed Files: source/net/yacy/cora/lod/Literal.java, source/net/yacy/cora/lod/Node.java, source/net/yacy/cora/lod/Syntax.java, source/net/yacy/cora/lod/TripleStore.java, source/net/yacy/cora/lod/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/CreativeCommons.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Foaf.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Rdf.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java
Sat Dec 17 01:27:08 CET 2011
by Michael Christen
Removed handling of components objects for URIMetadataRows.
This is a preparation to replace this rows with nodes from the node
store.
Changed Files: htroot/Bookmarks.java, htroot/CrawlResults.java, htroot/IndexControlRWIs_p.java, htroot/IndexControlURLs_p.java, htroot/ViewFile.java, htroot/api/yacydoc.java, htroot/api/ymarks/add_ymark.java, htroot/yacy/crawlReceipt.java, htroot/yacy/transferURL.java, htroot/yacy/urls.java, htroot/yacysearch.java, source/de/anomic/crawler/ResultURLs.java, source/de/anomic/data/ymark/YMarkMetadata.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/index/MetadataRepository.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/ResultEntry.java, source/net/yacy/search/snippet/TextSnippet.java
Fri Dec 16 23:59:29 CET 2011
by Michael Christen
refactoring
Changed Files: htroot/Supporter.java, htroot/Surftips.java, htroot/api/termlist_p.java, htroot/yacy/search.java, htroot/yacysearchtrailer.java, source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/ResultURLs.java, source/de/anomic/data/DidYouMean.java, source/de/anomic/data/UserDB.java, source/net/yacy/cora/lod/Node.java, source/net/yacy/cora/lod/TripleStore.java, source/net/yacy/cora/order/AbstractOrder.java, source/net/yacy/cora/order/ByteOrder.java, source/net/yacy/cora/order/CloneableIterator.java, source/net/yacy/cora/order/CloneableMapIterator.java, source/net/yacy/cora/order/Order.java, source/net/yacy/cora/order/RatingOrder.java, source/net/yacy/cora/services/federated/SearchHub.java, source/net/yacy/cora/services/federated/SearchResult.java, source/net/yacy/cora/sorting/AbstractScoreMap.java, source/net/yacy/cora/sorting/ClusteredScoreMap.java, source/net/yacy/cora/sorting/ConcurrentScoreMap.java, source/net/yacy/cora/sorting/OrderedScoreMap.java, source/net/yacy/cora/sorting/Rating.java, source/net/yacy/cora/sorting/ReversibleScoreMap.java, source/net/yacy/cora/sorting/ScoreComparator.java, source/net/yacy/cora/sorting/ScoreMap.java, source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java, source/net/yacy/cora/storage/AbstractMapStore.java, source/net/yacy/cora/storage/MapStore.java, source/net/yacy/dbtest.java, source/net/yacy/document/WordCache.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/Evaluation.java, source/net/yacy/kelondro/blob/ArrayStack.java, source/net/yacy/kelondro/blob/BEncodedHeap.java, source/net/yacy/kelondro/blob/BEncodedHeapBag.java, source/net/yacy/kelondro/blob/BEncodedHeapShard.java, source/net/yacy/kelondro/blob/BLOB.java, source/net/yacy/kelondro/blob/Compressor.java, source/net/yacy/kelondro/blob/Heap.java, source/net/yacy/kelondro/blob/HeapModifier.java, source/net/yacy/kelondro/blob/HeapReader.java, source/net/yacy/kelondro/blob/HeapWriter.java, source/net/yacy/kelondro/blob/MapDataMining.java, source/net/yacy/kelondro/blob/MapHeap.java, source/net/yacy/kelondro/index/BinSearch.java, source/net/yacy/kelondro/index/BufferedObjectIndex.java, source/net/yacy/kelondro/index/Cache.java, source/net/yacy/kelondro/index/HandleMap.java, source/net/yacy/kelondro/index/HandleSet.java, source/net/yacy/kelondro/index/Index.java, source/net/yacy/kelondro/index/RAMIndex.java, source/net/yacy/kelondro/index/RAMIndexCluster.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/index/RowCollection.java, source/net/yacy/kelondro/index/RowSet.java, source/net/yacy/kelondro/order/Base64Order.java, source/net/yacy/kelondro/order/MergeIterator.java, source/net/yacy/kelondro/order/NaturalOrder.java, source/net/yacy/kelondro/order/RotateIterator.java, source/net/yacy/kelondro/order/StackIterator.java, source/net/yacy/kelondro/order/StringOrder.java, source/net/yacy/kelondro/rwi/AbstractBufferedIndex.java, source/net/yacy/kelondro/rwi/AbstractIndex.java, source/net/yacy/kelondro/rwi/BufferedIndex.java, source/net/yacy/kelondro/rwi/Index.java, source/net/yacy/kelondro/rwi/IndexCell.java, source/net/yacy/kelondro/rwi/IndexReader.java, source/net/yacy/kelondro/rwi/ReferenceContainer.java, source/net/yacy/kelondro/rwi/ReferenceContainerArray.java, source/net/yacy/kelondro/rwi/ReferenceContainerCache.java, source/net/yacy/kelondro/rwi/ReferenceContainerOrder.java, source/net/yacy/kelondro/rwi/ReferenceIterator.java, source/net/yacy/kelondro/table/SQLTable.java, source/net/yacy/kelondro/table/SplitTable.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/kelondro/util/ByteArray.java, source/net/yacy/peers/Seed.java, source/net/yacy/peers/dht/PeerSelection.java, source/net/yacy/search/index/MetadataRepository.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/ranking/BlockRank.java, source/net/yacy/search/ranking/ReferenceOrder.java, source/net/yacy/yacy.java
Thu Dec 15 15:15:53 CET 2011
by Michael Christen
performance hacks
Changed Files: source/net/yacy/cora/ranking/ClusteredScoreMap.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/ContentTransformer.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/kelondro/blob/MapDataMining.java, source/net/yacy/kelondro/blob/MapHeap.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/kelondro/io/CharBuffer.java, source/net/yacy/peers/SeedDB.java, source/net/yacy/yacy.java
Wed Dec 14 22:15:51 CET 2011
by Michael Christen
added rules to set specific RWIs as private RWIs which are not
transmitted to remote peers. This will be used for private index copies
and phonetic indexes.
Changed Files: htroot/IndexControlRWIs_p.java, htroot/api/termlist_p.java, source/net/yacy/kelondro/blob/Heap.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/kelondro/data/word/Word.java, source/net/yacy/kelondro/order/Base64Order.java, source/net/yacy/kelondro/rwi/AbstractBufferedIndex.java, source/net/yacy/kelondro/rwi/AbstractIndex.java, source/net/yacy/kelondro/rwi/BufferedIndex.java, source/net/yacy/kelondro/rwi/Index.java, source/net/yacy/kelondro/rwi/IndexCell.java, source/net/yacy/kelondro/rwi/IndexReader.java, source/net/yacy/kelondro/rwi/ReferenceContainerArray.java, source/net/yacy/kelondro/rwi/ReferenceContainerCache.java, source/net/yacy/peers/dht/Dispatcher.java, source/net/yacy/peers/dht/PeerSelection.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/QueryParams.java
Tue Dec 13 00:16:05 CET 2011
by Michael Peter Christen
added feature as requested in
http://forum.yacy-websuche.de/viewtopic.php?f=18&t=3461
The search can now be configured with a non-display host list.
the search will always exlude the given list of host unless they are
requested directly using the host navigation
Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/yacy/search.java, htroot/yacysearch.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java
Tue Dec 06 15:28:48 CET 2011
by Michael Christen
added some pauses into the search process which shall produce
better-ranked search results. without that pauses the result page will
only contain links from the peer that answers first which is not a good
average picture of all the peers that provided results
Changed Files: source/de/anomic/server/serverSwitch.java, source/net/yacy/kelondro/blob/HeapModifier.java, source/net/yacy/peers/Protocol.java, source/net/yacy/peers/graphics/WebStructureGraph.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/ContentDomain.java
Sun Dec 04 12:15:03 CET 2011
by Michael Christen
added pull request from als plus an NPE fix
Changed Files: .classpath, build.properties, source/de/anomic/data/ymark/YMarkAutoTagger.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/SentenceReader.java, source/net/yacy/document/TextParser.java, source/net/yacy/document/WordTokenizer.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/kelondro/blob/ArrayStack.java, source/net/yacy/kelondro/index/RowCollection.java, source/net/yacy/kelondro/io/CharBuffer.java
Wed Nov 30 21:50:41 CET 2011
by orbiter
- fixed network graphic
- debuged evaluation tables
- changed cache settings in template engine
- some speed hacks
- changed int angles for peer positions in network graphic to double angles

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8124 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/Network.html, htroot/Network.java, htroot/NetworkPicture.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/http/server/TemplateEngine.java, source/net/yacy/cora/ranking/ClusteredScoreMap.java, source/net/yacy/cora/ranking/ConcurrentScoreMap.java, source/net/yacy/kelondro/blob/MapDataMining.java, source/net/yacy/kelondro/blob/MapHeap.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/peers/graphics/NetworkGraph.java, source/net/yacy/visualization/PrintTool.java, source/net/yacy/visualization/RasterPlotter.java
Wed Nov 30 12:15:54 CET 2011
by Al Sutton
Initial performance improvements
Changed Files: .classpath, build.properties, source/de/anomic/data/ymark/YMarkAutoTagger.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/SentenceReader.java, source/net/yacy/document/WordTokenizer.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/kelondro/blob/ArrayStack.java, source/net/yacy/kelondro/blob/MapHeap.java, source/net/yacy/kelondro/index/RowCollection.java, source/net/yacy/kelondro/io/CharBuffer.java


Bugfixes   
Jump to: YaCy Release 1.02 top / Other Changes

CommitDescription
Fri Feb 24 00:50:46 CET 2012
by Michael Peter Christen
ipv6 bugfix
Changed Files: source/net/yacy/cora/document/MultiProtocolURI.java
Fri Feb 24 00:38:57 CET 2012
by Michael Peter Christen
fix for http://bugs.yacy.net/view.php?id=148
Changed Files: htroot/CrawlResults.java, source/de/anomic/crawler/CrawlStacker.java, source/net/yacy/cora/document/MultiProtocolURI.java
Tue Feb 21 22:31:14 CET 2012
by Michael Peter Christen
removed debug output
Changed Files: htroot/yacy/transferRWI.java
Thu Feb 02 23:38:23 CET 2012
by Michael Peter Christen
bugfixes
Changed Files: htroot/Crawler_p.html, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/document/parser/htmlParser.java
Wed Feb 01 00:22:43 CET 2012
by Michael Peter Christen
fixes in solr schema file
Changed Files: htroot/api/schema_p.xml
Wed Feb 01 00:15:59 CET 2012
by Michael Peter Christen
fixed parser extension deny list generation and usage
Changed Files: htroot/ConfigParser.java, source/net/yacy/document/TextParser.java, source/net/yacy/search/Switchboard.java
Thu Jan 26 18:10:34 CET 2012
by Michael Peter Christen
fix for host navigator
Changed Files: source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/query/RWIProcess.java
Thu Jan 26 16:44:30 CET 2012
by Michael Peter Christen
fix for single-word vocabulary lines
Changed Files: source/net/yacy/document/Autotagging.java
Thu Jan 26 15:32:30 CET 2012
by Michael Peter Christen
added option to have exception search result windows
Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/yacysearchitem.java, source/net/yacy/search/SwitchboardConstants.java
Wed Jan 18 11:58:51 CET 2012
by Michael Peter Christen
fix for http://bugs.yacy.net/view.php?id=131
Changed Files: htroot/yacysearchtrailer.json
Wed Jan 18 01:00:30 CET 2012
by Michael Peter Christen
bugfix for usage of multiple vocabulary navigators
Changed Files: htroot/yacysearch.java
Tue Jan 17 23:39:57 CET 2012
by Michael Peter Christen
npe bugfix
Changed Files: source/net/yacy/search/query/SnippetProcess.java
Sun Jan 15 12:08:46 CET 2012
by Michael Peter Christen
enriched log output to find NPE in HeapReader
Changed Files: source/net/yacy/kelondro/blob/HeapReader.java, source/net/yacy/kelondro/logging/Log.java
Fri Jan 13 11:24:08 CET 2012
by Michael Peter Christen
small fixes
Changed Files: source/net/yacy/document/Condenser.java, source/net/yacy/kelondro/io/CharBuffer.java, source/net/yacy/search/Switchboard.java
Mon Jan 09 03:02:35 CET 2012
by Michael Christen
fix for search process (it was aborted too early during remote search)
Changed Files: htroot/IndexControlRWIs_p.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java
Thu Jan 05 08:35:44 CET 2012
by Michael Christen
fix for concurrency problem and endless loop in /suggest.json
Changed Files: source/de/anomic/data/DidYouMean.java
Wed Jan 04 23:02:12 CET 2012
by Michael Christen
fix
Changed Files: source/de/anomic/crawler/CrawlQueues.java
Wed Jan 04 23:01:04 CET 2012
by Michael Christen
fix
Changed Files: source/de/anomic/crawler/CrawlQueues.java
Wed Jan 04 20:24:48 CET 2012
by Michael Christen
fix
Changed Files: source/net/yacy/repository/Blacklist.java
Mon Jan 02 02:10:39 CET 2012
by Michael Christen
fixed a bug in search sequence (caused emtpy results)
Changed Files: source/net/yacy/search/query/RWIProcess.java
Tue Dec 27 23:43:44 CET 2011
by Michael Christen
fix for search process
Changed Files: source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java
Tue Dec 27 20:59:03 CET 2011
by Michael Christen
make a bad fix even worse
Changed Files: htroot/yacysearch.java
Wed Dec 14 22:21:19 CET 2011
by Michael Christen
removed debug logging
Changed Files: source/net/yacy/peers/dht/PeerSelection.java
Sat Dec 10 01:35:38 CET 2011
by Michael Christen
small bugfixes for search result display and cache display
Changed Files: htroot/ViewFile.html, htroot/ViewFile.java, htroot/api/yacydoc.html, htroot/api/yacydoc.java, htroot/yacysearch.html, htroot/yacysearchitem.html, source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java
Wed Dec 07 00:52:04 CET 2011
by Michael Christen
patch for a bug that I don't understand by now.
Changed Files: source/net/yacy/kelondro/io/CachedFileWriter.java
Wed Dec 07 00:18:34 CET 2011
by Michael Christen
fixed a deadlock during secondary remote search
Changed Files: source/net/yacy/kelondro/data/word/WordReferenceFactory.java, source/net/yacy/search/query/SearchEvent.java
Tue Dec 06 22:05:22 CET 2011
by Michael Christen
fixes for dependency on svn
Changed Files: defaults/yacy.init, htroot/ConfigUpdate_p.java, htroot/Steering.java, source/net/yacy/search/Switchboard.java, yacy-svn-4.spec
Tue Dec 06 02:22:56 CET 2011
by Michael Christen
fix for stretched network image
Changed Files: htroot/NetworkPicture.java
Mon Dec 05 23:46:42 CET 2011
by Michael Christen
fix for http://bugs.yacy.net/view.php?id=87
Changed Files: source/de/anomic/crawler/retrieval/Request.java


Other Changes   
Jump to: YaCy Release 1.02 top / Bugfixes

CommitDescription
Sat Feb 25 15:42:29 CET 2012
by Michael Peter Christen
animation of the web structure picture
Changed Files: htroot/WatchWebStructure_p.html, htroot/WatchWebStructure_p.java, htroot/WebStructurePicture_p.java, htroot/env/templates/header.template, source/net/yacy/peers/graphics/WebStructureGraph.java
Sat Feb 25 15:41:20 CET 2012
by Michael Peter Christen
use tld heuristic to check if a domain is local or global
Changed Files: source/net/yacy/cora/protocol/Domains.java
Sat Feb 25 14:07:20 CET 2012
by Michael Peter Christen
use less proccesses in process pool
Changed Files: source/net/yacy/kelondro/blob/ArrayStack.java
Sat Feb 25 14:07:02 CET 2012
by Michael Peter Christen
protection against strange answers from remote peers during search
Changed Files: source/net/yacy/kelondro/util/FileUtils.java, source/net/yacy/peers/Protocol.java
Sat Feb 25 12:59:19 CET 2012
by Michael Peter Christen
Release_1.02
Changed Files: build.properties
Sat Feb 25 12:58:12 CET 2012
by Michael Peter Christen
changed ranking
Changed Files: source/net/yacy/search/ranking/RankingProfile.java
Sat Feb 25 12:57:59 CET 2012
by Michael Peter Christen
removed scroogle (scroogle is dead)
Changed Files: defaults/yacy.init, htroot/ConfigHeuristics_p.html
Sat Feb 25 12:42:13 CET 2012
by Michael Peter Christen
added test code
Changed Files: source/net/yacy/search/index/Segment.java
Fri Feb 24 09:11:48 CET 2012
by Lotus
update installed jre version
Changed Files: build.nsi
Fri Feb 24 02:46:56 CET 2012
by Michael Peter Christen
Revert "fix for page navigation: show only as much pages as are available for given navigation constraints, not as given by total results size"

This reverts commit 73f5a9e8b3b1481bc52ca0c497089d3d6ac5da02.
Changed Files: htroot/js/yacysearch.js
Fri Feb 24 02:31:03 CET 2012
by Michael Peter Christen
fix for page navigation: show only as much pages as are available for
given navigation constraints, not as given by total results size
Changed Files: htroot/js/yacysearch.js
Fri Feb 24 02:28:40 CET 2012
by Michael Peter Christen
fixed a bug with navigation: if a navigation was applied to file type or
protocol, then it was not possible to remove that again. This is the fix
for that.
Changed Files: htroot/yacysearchtrailer.java
Fri Feb 24 02:15:27 CET 2012
by Michael Peter Christen
catch OOM errors during scanning
Changed Files: source/net/yacy/cora/protocol/Scanner.java
Fri Feb 24 02:14:54 CET 2012
by Michael Peter Christen
enhanced hint how to enter file:// urls
Changed Files: htroot/CrawlStartExpert_p.html, htroot/CrawlStartSite_p.html
Fri Feb 24 01:35:01 CET 2012
by Michael Peter Christen
updated commons io from 2.0.1 to 2.1
Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, lib/commons-io-2.1.jar, lib/commons-io-2.1.license
Fri Feb 24 01:07:15 CET 2012
by Michael Peter Christen
added classes for citation references (for new citation ranking)
Changed Files: source/net/yacy/kelondro/data/citation/CitationReference.java, source/net/yacy/kelondro/data/citation/CitationReferenceFactory.java
Fri Feb 24 01:06:30 CET 2012
by Michael Peter Christen
updated http client libraries
Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, lib/httpclient-4.1.3.License, lib/httpclient-4.1.3.jar, lib/httpmime-4.1.3.License, lib/httpmime-4.1.3.jar
Thu Feb 23 10:07:13 CET 2012
by Michael Peter Christen
Merge commit 'e15e633a0128b8d31011283a65b4ef26a6dddcd8'
Changed Files: htroot/CrawlProfileEditor_p.html, htroot/Table_API_p.html, htroot/Table_API_p.java, nbproject/project.xml
Thu Feb 23 02:40:07 CET 2012
by reger
Bugfix for IE9 (doesn't accept html form within form)
changes of API schedule row data changed form input form to unique field names
using row pk.
Fix for issue 96 http://bugs.yacy.net/view.php?id=96

IE9-64bit doesn't interprete iframe with align parameter as desired
misaligns following content (in CrawlProfileEditor_p.html)
Changed Files: htroot/CrawlProfileEditor_p.html, htroot/Table_API_p.html, htroot/Table_API_p.java
Thu Feb 23 01:22:29 CET 2012
by Michael Peter Christen
added new citation reference data structure that shall be used for a
citation ranking
Changed Files:
Thu Feb 23 01:21:24 CET 2012
by Michael Peter Christen
more tolerant merge iterator
Changed Files: source/net/yacy/kelondro/index/BufferedObjectIndex.java
Thu Feb 23 01:20:42 CET 2012
by Michael Peter Christen
more logging in resource observer
Changed Files: source/de/anomic/crawler/ResourceObserver.java
Thu Feb 23 01:20:24 CET 2012
by Michael Peter Christen
enhanced crawler
Changed Files: source/de/anomic/crawler/Balancer.java
Wed Feb 22 18:41:32 CET 2012
by Lotus
delete yacy.running after kill as requested in
http://forum.yacy-websuche.de/viewtopic.php?t=3835
Changed Files: killYACY.sh
Tue Feb 14 20:54:19 CET 2012
by low012
*) Small change which should solve problem with cgitb module in Python CGI scripts.
Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java
Tue Feb 07 16:13:13 CET 2012
by Lotus
fix must match filter for full domain crawl

allow:
http://www.example.com
http://www.example.com/
http://www.example.com/abc.html?xyz=q
block:
http://www.example.com.cn
http://www.example.com.cn/dsf
Changed Files: source/de/anomic/crawler/CrawlProfile.java
Thu Feb 02 09:55:27 CET 2012
by Michael Peter Christen
free some memory after parsing html
Changed Files: source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/Scraper.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/kelondro/io/CharBuffer.java, source/net/yacy/peers/operation/yacyRelease.java
Thu Feb 02 07:37:00 CET 2012
by Michael Peter Christen
memory hacks
Changed Files: source/de/anomic/data/BookmarkHelper.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/ContentTransformer.java, source/net/yacy/document/parser/html/ScraperInputStream.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/document/parser/pdfParser.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/kelondro/io/CharBuffer.java
Thu Feb 02 06:43:57 CET 2012
by Michael Peter Christen
small redesign of blob column index and usage
Changed Files: source/net/yacy/kelondro/blob/MapColumnIndex.java, source/net/yacy/kelondro/blob/MapDataMining.java, source/net/yacy/peers/SeedDB.java
Thu Feb 02 06:43:15 CET 2012
by Michael Peter Christen
performance hack
Changed Files: source/net/yacy/kelondro/util/ByteBuffer.java
Wed Feb 01 23:27:59 CET 2012
by Michael Peter Christen
performance hack: better space grow in CharBuffer (speeds up html
parser)
Changed Files: source/net/yacy/kelondro/io/CharBuffer.java
Wed Feb 01 18:13:31 CET 2012
by Michael Peter Christen
changed storage of search words: keep order
Changed Files: htroot/api/timeline.java, htroot/yacysearch.java, htroot/yacysearchitem.java, source/net/yacy/kelondro/data/word/Word.java, source/net/yacy/kelondro/util/SetTools.java, source/net/yacy/search/query/QueryParams.java
Wed Feb 01 18:12:59 CET 2012
by Michael Peter Christen
changed generation of protocol information
Changed Files: source/net/yacy/cora/services/federated/solr/SolrScheme.java
Wed Feb 01 15:11:21 CET 2012
by Michael Peter Christen
added a column index for tables in blob files. This is heavily used
during receiving of DHT submissions and when answering remote search
requests. Both events together may have caused IO-deadlocking and this
commit shall fix that.
Changed Files: source/net/yacy/kelondro/blob/MapColumnIndex.java, source/net/yacy/kelondro/blob/MapDataMining.java, source/net/yacy/kelondro/blob/MapHeap.java, source/net/yacy/kelondro/util/ByteBuffer.java, source/net/yacy/peers/SeedDB.java
Wed Feb 01 00:49:40 CET 2012
by Michael Peter Christen
added missing apicat.sh
Changed Files: build.xml
Tue Jan 31 23:46:35 CET 2012
by Michael Peter Christen
there is no noindex, only nofollow in links
Changed Files: defaults/solr.keys.list, source/net/yacy/cora/services/federated/solr/SolrScheme.java, source/net/yacy/document/Document.java
Tue Jan 31 23:21:49 CET 2012
by Michael Peter Christen
added shell script to get a servlet. this is the same as apicall.sh but it prints the result to stdout
Changed Files: bin/apicat.sh
Tue Jan 31 22:21:48 CET 2012
by Michael Peter Christen
do not add new solr fields as activated fields
Changed Files: source/net/yacy/cora/storage/ConfigurationSet.java, source/net/yacy/search/Switchboard.java
Tue Jan 31 21:13:49 CET 2012
by Michael Peter Christen
serialized some database access methods
Changed Files: source/net/yacy/kelondro/table/SplitTable.java, source/net/yacy/search/index/MetadataRepository.java
Tue Jan 31 18:17:25 CET 2012
by Michael Peter Christen
added a synchronization around iterations to prevent IO-deadlocking
during concurrent remote search requests
Changed Files: source/net/yacy/peers/SeedDB.java
Mon Jan 30 20:02:02 CET 2012
by Lotus
more label on search options (usability)
Changed Files: htroot/index.html
Sun Jan 29 20:35:48 CET 2012
by Michael Peter Christen
reduced target file site to 64mb
Changed Files: source/net/yacy/search/index/Segment.java
Sun Jan 29 20:06:10 CET 2012
by reger
Merge rc1/master
Changed Files: htroot/yacy/search.java
Sun Jan 29 19:25:09 CET 2012
by Michael Peter Christen
remote search does not do snippet generation
Changed Files: htroot/yacy/search.java
Sun Jan 29 00:48:54 CET 2012
by reger
Merge rc1/master
Changed Files: htroot/Status.java, htroot/api/feed.java
Sat Jan 28 13:25:12 CET 2012
by Lotus
xss hardening on Status.html
Changed Files: htroot/Status.java, htroot/api/feed.java
Thu Jan 26 22:25:42 CET 2012
by reger
upd Netbeans IDE lib setting

to use currently updated jars (e.g. solrj3.5.0 etc.)
Changed Files: nbproject/project.xml
Thu Jan 26 11:20:14 CET 2012
by Michael Peter Christen
added example vocabularies and explanation how to use them
Changed Files: vocabularies/de/Freizeitaktivita?ten.vocabulary, vocabularies/de/Freizeitaktivitäten.vocabulary, vocabularies/de/Stadtthemen.vocabulary, vocabularies/readme.txt
Thu Jan 26 10:47:40 CET 2012
by Michael Peter Christen
Merge remote branch 'reger/master'
Changed Files: source/net/yacy/repository/LoaderDispatcher.java
Thu Jan 26 04:10:44 CET 2012
by reger
Bugfix class repository.Loaddispatcher fixed download file limit of 10000

line 355: final Response response = this.load(request, cachePolicy, 10000, true);
Changed Files: source/net/yacy/repository/LoaderDispatcher.java
Thu Jan 26 01:09:34 CET 2012
by Michael Peter Christen
show less navigation by default
Changed Files: htroot/yacysearchtrailer.java
Wed Jan 25 12:48:48 CET 2012
by Michael Peter Christen
performance hack
Changed Files: source/net/yacy/document/SnippetExtractor.java, source/net/yacy/document/WordTokenizer.java, source/net/yacy/kelondro/order/Digest.java, source/net/yacy/search/snippet/MediaSnippet.java, source/net/yacy/search/snippet/TextSnippet.java
Wed Jan 25 12:28:56 CET 2012
by Michael Peter Christen
performance hack
Changed Files: source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/ranking/RankingProfile.java
Wed Jan 25 12:13:03 CET 2012
by Michael Peter Christen
no DoS protection for intranet mode
Changed Files: htroot/yacysearch.java
Wed Jan 25 12:07:24 CET 2012
by Michael Peter Christen
automatic switching off of navigation that is not useful
Changed Files: htroot/yacysearchtrailer.java
Wed Jan 25 11:53:25 CET 2012
by Michael Peter Christen
better rules for default open/close of navigation objetcs
Changed Files: htroot/yacysearch.html, htroot/yacysearchtrailer.html, htroot/yacysearchtrailer.java
Wed Jan 25 11:19:18 CET 2012
by Michael Peter Christen
added delete-button for host navigation
Changed Files: source/net/yacy/search/query/RWIProcess.java
Wed Jan 25 11:11:42 CET 2012
by Michael Peter Christen
author navigator can be switched off
Changed Files: htroot/yacysearch.java, htroot/yacysearchtrailer.java, source/net/yacy/search/query/RWIProcess.java
Wed Jan 25 02:54:52 CET 2012
by Michael Peter Christen
made the protocol navigator reversible
Changed Files: htroot/yacysearchtrailer.java, source/net/yacy/search/query/RWIProcess.java
Wed Jan 25 02:50:06 CET 2012
by Michael Peter Christen
made the filetype navigator be able to deselect the search constraint
Changed Files: htroot/yacysearchtrailer.java, source/net/yacy/search/query/RWIProcess.java
Wed Jan 25 02:42:24 CET 2012
by Michael Peter Christen
enhanced url parser to understand urls with & instead of & in post
urls
Changed Files: source/de/anomic/http/server/HTTPDemon.java
Wed Jan 25 00:22:51 CET 2012
by Michael Peter Christen
added a remove-navigation for vocabularies
Changed Files: htroot/yacysearchtrailer.java
Tue Jan 24 19:03:47 CET 2012
by Michael Peter Christen
changed navigation links: now using checkboxes.
This looks better and allows that negative checkboxes (such that remove
the navigation) are possible. These are not yet implemented (comming
next)
Changed Files: htroot/env/base.css, htroot/yacysearch.html, htroot/yacysearch.java, htroot/yacysearchtrailer.html, htroot/yacysearchtrailer.java, htroot/yacysearchtrailer.json
Mon Jan 23 20:58:36 CET 2012
by reger
PDFParser - return at least first 3 pages of PDF

fix for pdf parsing without returning parsed text due to interruption by
time out.
Changed Files: source/net/yacy/document/parser/pdfParser.java
Mon Jan 23 17:27:58 CET 2012
by Michael Peter Christen
removed pdf from default parser deny list
Changed Files: defaults/yacy.init
Mon Jan 23 17:27:29 CET 2012
by Michael Peter Christen
using the generic document parser for crawl starts instead of the html
parser. This makes it possible that every type of document can be a
crawl start point, not only text documents or html documents. Testet
this with a pdf document.
Changed Files: .classpath, htroot/Crawler_p.java, htroot/api/getpageinfo_p.java, source/net/yacy/peers/operation/yacyRelease.java, source/net/yacy/repository/LoaderDispatcher.java
Mon Jan 23 11:20:32 CET 2012
by Michael Peter Christen
Merge commit 'b60e2e952102c3eae40ab98c892a8c7d1b478345'
Changed Files: yacy.logging
Mon Jan 23 04:33:07 CET 2012
by reger
PDFParser - return at least first 3 pages of PDF

fix for pdf parsing without returning parsed text due to interruption by time out.
Changed Files: yacy.logging
Mon Jan 23 00:47:25 CET 2012
by Michael Peter Christen
better error messages
Changed Files: source/net/yacy/kelondro/rwi/ReferenceIterator.java
Mon Jan 23 00:46:02 CET 2012
by Michael Peter Christen
small enhancements in pdf parser
Changed Files: source/net/yacy/document/parser/pdfParser.java
Mon Jan 23 00:45:32 CET 2012
by Michael Peter Christen
timeout = 5000 instead 3000
Changed Files: source/net/yacy/kelondro/rwi/ReferenceContainerArray.java
Sun Jan 22 19:08:27 CET 2012
by Michael Peter Christen
Merge commit 'b616de59735d33b922b7d2fbccdcc9031b77fa6e'
Changed Files: source/net/yacy/document/parser/pdfParser.java
Sat Jan 21 18:33:21 CET 2012
by Lotus
Java update
Changed Files: build.nsi
Sat Jan 21 18:29:53 CET 2012
by Lotus
highlight changed row on api table
Changed Files: skins/pdblue.css
Sat Jan 21 03:15:12 CET 2012
by reger
PDFParser - return at least first 3 pages of PDF

fix for pdf parsing without returning parsed text due to interruption by time out.
Changed Files: source/net/yacy/document/parser/pdfParser.java
Thu Jan 19 23:07:15 CET 2012
by Michael Peter Christen
for for crawl start with smb url
Changed Files: htroot/api/getpageinfo_p.java
Thu Jan 19 23:06:09 CET 2012
by Michael Peter Christen
fix for bookmark crash with possible side-effects on crawl start after
the crash
Changed Files: source/de/anomic/data/BookmarksDB.java
Thu Jan 19 16:54:09 CET 2012
by Lotus
variable search works at least on Firefox again
Changed Files: htroot/ConfigProperties_p.html
Thu Jan 19 16:52:26 CET 2012
by Lotus
win installer check at least for 4gb space. resource observer pauses
crawling at 3gb free space by default and informs user what to do. so
1gb can be used by yacy at full feature. 30gb warning comes quite often
on installation time. users are confused about it and may never reach
it.
Changed Files: build.nsi
Wed Jan 18 20:47:09 CET 2012
by Lotus
refactoring of tray icon class,
now uses Java 6 methods natively
Changed Files: defaults/yacy.init, htroot/Status_p.inc, source/net/yacy/gui/Tray.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/SwitchboardConstants.java, source/net/yacy/yacy.java
Wed Jan 18 01:21:41 CET 2012
by Michael Peter Christen
updated libraries
Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, lib/apache-solr-solrj-3.5.0.License, lib/apache-solr-solrj-3.5.0.jar, lib/commons-codec-1.6.License, lib/commons-codec-1.6.jar, lib/httpcore-4.1.4.License, lib/httpcore-4.1.4.jar
Tue Jan 17 20:43:19 CET 2012
by low012
*) small fix to make password change function of reconfigureYACY.sh work
again
Changed Files: source/net/yacy/kelondro/order/Digest.java
Tue Jan 17 17:45:28 CET 2012
by Michael Peter Christen
added Ukrainian translation
Changed Files: htroot/ConfigBasic.html, htroot/ConfigBasic.java, locales/uk.lng, source/de/anomic/data/Translator.java
Tue Jan 17 16:44:30 CET 2012
by Michael Peter Christen
get more navigation details to search results
Changed Files: source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java
Tue Jan 17 16:43:34 CET 2012
by Michael Peter Christen
added switches to ConfigParser to accept/deny documents by their
extension
Changed Files: htroot/ConfigParser.html, htroot/ConfigParser.java, source/net/yacy/document/TextParser.java
Tue Jan 17 02:10:05 CET 2012
by Michael Peter Christen
suppress auto-tagged subject entries when sending out or receiving
metadata from other peers
Changed Files: source/net/yacy/document/Autotagging.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java
Mon Jan 16 20:08:24 CET 2012
by Lotus
jump back to where we want to modify the scheduler in api steering after
submit
Changed Files: htroot/Table_API_p.html
Mon Jan 16 16:59:58 CET 2012
by sixcooler
correct 'avaiable()' to use max of young / eden
Changed Files: source/net/yacy/kelondro/util/GenerationMemoryStrategy.java
Mon Jan 16 09:05:10 CET 2012
by Alexander Fieger
created an working free-form project for netbeans (7.1)
Changed Files: .gitignore, nbproject/project.xml
Mon Jan 16 09:01:14 CET 2012
by Alexander Fieger
removed not working netbeans project. This must be an free-form project and not an java project.
Changed Files:
Mon Jan 16 01:46:12 CET 2012
by sixcooler
respect non-reserved Memory in GenerationMemoryStrategy
and enable it again
Changed Files: source/net/yacy/kelondro/util/GenerationMemoryStrategy.java, source/net/yacy/kelondro/util/MemoryControl.java
Mon Jan 16 01:05:30 CET 2012
by Michael Peter Christen
replaced Thread initialization with ExecutorService pool for delete
method. This is much faster and produces less blocking when using the
Compressor class which is used by the HTCache. I.e. picture search is
much faster now.
Changed Files: source/net/yacy/kelondro/blob/ArrayStack.java
Sun Jan 15 22:17:57 CET 2012
by Michael Peter Christen
added autotagging to document condenser:
- tags that are automatically generated now enrich the dc:subject
- auto-generated tags have a '$' at the beginning of the tag
- auto-generated tags lead the tag name with a vocabulary name
each tag has the form
$<vocabulary-name>:<tag-printname-space-replaced-by-'_'>
Changed Files: source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java
Sun Jan 15 21:58:18 CET 2012
by Michael Peter Christen
emergency disabling of GenerationMemoryStrategy because of non-working
available-method
Changed Files: source/net/yacy/kelondro/blob/HeapReader.java, source/net/yacy/kelondro/util/MemoryControl.java
Sun Jan 15 19:01:05 CET 2012
by Lotus
Windows installer now detects reliably whether YaCy runs. A file lock on
the yacy.running file has been implemented.
Changed Files: build.nsi, source/net/yacy/yacy.java
Fri Jan 13 11:26:22 CET 2012
by Michael Peter Christen
added automatic generation of a solr schema.xml file
Changed Files: htroot/api/schema_p.java, htroot/api/schema_p.xml
Fri Jan 13 11:25:15 CET 2012
by Michael Peter Christen
updated solr scheme: generic declaration of solr schemes
Changed Files: defaults/solr.keys.list, source/net/yacy/cora/services/federated/solr/SolrScheme.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
Thu Jan 12 23:30:23 CET 2012
by apfelmaennchen
fix for http://bugs.yacy.net/view.php?id=101 - the default crawl
depth for bookmarks is now editable.
Changed Files: htroot/YMarks.html, htroot/js/yacy-ymarks-bookmark-actions.js
Tue Jan 10 03:03:12 CET 2012
by Michael Peter Christen
WorkflowProcess is forced to make small pauses if shortMemoryStatus is
reached.
Changed Files: source/net/yacy/kelondro/table/Table.java, source/net/yacy/kelondro/workflow/AbstractBlockingThread.java, source/net/yacy/kelondro/workflow/AbstractThread.java, source/net/yacy/kelondro/workflow/WorkflowProcessor.java
Tue Jan 10 03:02:17 CET 2012
by Michael Peter Christen
set a limit to CharBuffer object size to fight against bad/too large
content
Changed Files: source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/ContentTransformer.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/document/parser/pdfParser.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/kelondro/io/CharBuffer.java
Tue Jan 10 03:00:55 CET 2012
by Michael Peter Christen
enhanced search process
Changed Files: htroot/IndexFederated_p.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java
Mon Jan 09 22:43:55 CET 2012
by sof
Solved (http://bugs.yacy.net/view.php?id=124) accessibility issue with
page 'Ranking_p.html'
Changed Files: htroot/Ranking_p.html
Mon Jan 09 20:54:14 CET 2012
by Michael Peter Christen
less noise if a browser cannot be opened
Changed Files: source/net/yacy/gui/framework/Browser.java
Mon Jan 09 01:49:37 CET 2012
by Marek Otahal
Run from Java the whole app YACY

start for java webStart
allow for better integration with IDE

Conflicts:
	source/net/yacy/gui/framework/Browser.java
Changed Files: build.xml, source/net/yacy/utils/StartFromJava.java
Sun Jan 08 16:06:26 CET 2012
by Marek Otahal
netbeans: build script: make compressed jar w/ all libraries

+ other improvements
FIXME: run ant clean all on each clean/rebuild
Changed Files: nbproject/project.properties
Fri Jan 06 21:36:45 CET 2012
by Marek Otahal
just a little faster toString

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: source/de/anomic/server/serverObjects.java
Fri Jan 06 20:41:30 CET 2012
by Marek Otahal
serverSwitch get(App/Data)Path() use common helper method

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: source/de/anomic/server/serverSwitch.java
Fri Jan 06 20:23:38 CET 2012
by Marek Otahal
just comment + shorter code in serverSwitch

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: source/de/anomic/server/serverSwitch.java
Fri Jan 06 05:41:54 CET 2012
by Marek Otahal
small fix

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: htroot/CacheResource_p.java
Fri Jan 06 05:30:04 CET 2012
by Marek Otahal
update javadoc, does not throw IOException

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: source/de/anomic/http/client/Cache.java
Fri Jan 06 02:01:20 CET 2012
by Marek Otahal
Blacklist loadList() remove duplicates by using Set

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: source/net/yacy/repository/Blacklist.java, source/net/yacy/search/index/Segment.java
Fri Jan 06 01:42:37 CET 2012
by Marek Otahal
little fix in copy()

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: source/net/yacy/kelondro/util/FileUtils.java
Fri Jan 06 01:10:05 CET 2012
by Marek Otahal
make ConnectionInfo comparable and sort list of connections in Connections_p

ConnectionInfo compare by initTime
Connections_p implement wish to sort connections, descending

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: htroot/Connections_p.java, source/net/yacy/cora/protocol/ConnectionInfo.java
Fri Jan 06 00:26:08 CET 2012
by Marek Otahal
Blog + BlogComments method propose() make similar + fix anonymous poster's IP resolve in Blog

this method share very much common code in both classes,
would be nice to unify
+fix some ugly code

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: htroot/Blog.java, htroot/BlogComments.java
Thu Jan 05 23:23:21 CET 2012
by Marek Otahal
BlogComments dateString() - use localized date/time format

use same method from Blog class, reduce code duplication

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: htroot/BlogComments.java
Thu Jan 05 23:17:28 CET 2012
by Marek Otahal
Blog dateString() print in localized date/time format

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: htroot/Blog.java
Thu Jan 05 22:23:50 CET 2012
by Marek Otahal
Blacklist addBlacklistEntry() - dont add an empty entry

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: htroot/Blacklist_p.java
Thu Jan 05 22:15:32 CET 2012
by Marek Otahal
add *.*~ to .gitignore

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: .gitignore
Thu Jan 05 20:39:15 CET 2012
by Marek Otahal
add support for development in netbeans

imported project from eclipse, now netbeans will automatically recognize
project folder, link needed libraries, build scripts etc. Just do Open project...

Signed-off-by: Marek Otahal <markotahal@gmail.com>
Changed Files: .gitignore, nb-build.xml, nbproject/build-impl.xml, nbproject/genfiles.properties, nbproject/project.properties, nbproject/project.xml
Sun Jan 08 02:13:52 CET 2012
by Michael Christen
vocabularies are now also used as source for a did-you-mean computation
Changed Files: source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/WordCache.java
Sun Jan 08 02:07:10 CET 2012
by Michael Christen
Dictionaries from words caches can now be used as autotagging vocabulary
Changed Files: source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/WordCache.java
Sun Jan 08 00:47:32 CET 2012
by Michael Peter Christen
redesign of WordCache to be prepared to hold multiple
independent dictionaries. Such dictionaries can then be also used as
simplified vocabularies.
Changed Files: source/net/yacy/document/WordCache.java
Sat Jan 07 17:34:38 CET 2012
by Michael Christen
added autotaggig stub .. only reading and parsing of vocabularies at
this time
Changed Files: htroot/DictionaryLoader_p.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/GeonamesLocalization.java, source/net/yacy/document/geolocalization/Localization.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java, source/net/yacy/document/geolocalization/OverarchingLocalization.java
Sat Jan 07 17:17:11 CET 2012
by Michael Peter Christen
added no-load queues to the crawler monitor
Changed Files: htroot/Crawler_p.html, htroot/js/Crawler.js
Sat Jan 07 12:45:40 CET 2012
by Michael Peter Christen
one more change for signed debian packages
Changed Files: debian/control
Sat Jan 07 12:37:02 CET 2012
by Michael Peter Christen
changed required setting for package signing
Changed Files: build.xml, debian/changelog, debian/control, debian/copyright
Thu Jan 05 18:33:05 CET 2012
by Michael Peter Christen
added noload statistic to servlets
Changed Files: htroot/CrawlStartScanner_p.java, htroot/Crawler_p.java, htroot/api/queues_p.java, htroot/api/queues_p.xml, htroot/api/status_p.java, htroot/api/status_p.xml, source/de/anomic/crawler/CrawlQueues.java, source/net/yacy/search/Switchboard.java
Sun Jan 01 11:59:14 CET 2012
by stbrumm
Type for Robinson-Mode/Private Perr added
Changed Files: source/net/yacy/peers/Seed.java
Tue Jan 03 14:38:03 CET 2012
by Michael Christen
added metadata node stub for metadata from blobs
Changed Files: source/net/yacy/kelondro/data/meta/URIMetadataNode.java
Mon Jan 02 02:14:05 CET 2012
by Michael Christen
enhancements in Blob retrieval: try to use less CPU resources by testing
a blog first that most certainly has wanted entries.
Changed Files: source/net/yacy/kelondro/blob/ArrayStack.java
Mon Jan 02 02:09:49 CET 2012
by Michael Christen
added checkalive script that can be called frequently to restart crashed
peers automatically
Changed Files: bin/checkalive.sh
Fri Dec 30 23:51:07 CET 2011
by Michael Christen
remove heuristics if index receive is switched off
Changed Files: htroot/ConfigNetwork_p.java
Fri Dec 30 02:52:15 CET 2011
by Michael Christen
added the 28c3 skin
Changed Files: skins/28c3.css
Thu Dec 29 14:37:19 CET 2011
by Michael Christen
better error handling for file loader
Changed Files: source/net/yacy/repository/LoaderDispatcher.java
Thu Dec 29 03:42:38 CET 2011
by Roland 'Quix0r' Haeder
Rewrote filesize() to (hopefully) avoid a NPE, rewrote Blacklist class to concurrent classes to avoid a CME
Changed Files: source/net/yacy/kelondro/io/Records.java, source/net/yacy/repository/Blacklist.java
Thu Dec 29 00:36:56 CET 2011
by Roland 'Quix0r' Haeder
Also this ... :( #2
Changed Files: source/de/anomic/crawler/CrawlQueues.java
Thu Dec 29 00:35:51 CET 2011
by Roland 'Quix0r' Haeder
Also this ... :(
Changed Files: source/de/anomic/crawler/CrawlQueues.java
Thu Dec 29 00:34:46 CET 2011
by Roland 'Quix0r' Haeder
Fix for ported fix from my old days ...
Changed Files: source/de/anomic/crawler/CrawlQueues.java
Wed Dec 28 21:40:44 CET 2011
by Roland Haeder
A concurrent access can happen on the blacklist (with latest introduced blacklist check in media snippet computation)
Changed Files: source/net/yacy/repository/Blacklist.java
Wed Dec 28 20:09:17 CET 2011
by Roland 'Quix0r' Haeder
Blacklist checks are now always turned on, in media searches (e.g. image search) images matching blacklist entries are no longer shown to the user
Changed Files: source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/snippet/MediaSnippet.java
Wed Dec 28 10:49:32 CET 2011
by Michael Christen
added more properties to opensearchdescription, see also:
http://bugs.yacy.net/view.php?id=114
Changed Files: htroot/opensearchdescription.xml
Wed Dec 28 02:46:29 CET 2011
by Michael Christen
add a check script that waits for stopYACY.sh to terminate. That makes
it easier to write control scripts around it. If you want that the
script terminates directly as before, call it concurrently or wrap it
with 'timeout' like:
timeout 10s ./stopYACY.sh
to stop after 10 seconds
Changed Files: stopYACY.sh
Wed Dec 28 01:12:44 CET 2011
by Michael Christen
the link to the path shall be the path
Changed Files: htroot/js/yacyinteractive.js
Wed Dec 28 01:12:23 CET 2011
by Michael Christen
show server list as server side include
Changed Files: htroot/yacyinteractive.html
Tue Dec 27 20:51:13 CET 2011
by Michael Christen
allow html in greeting line since that is set by administrator only.
html in that line may be wanted
Changed Files: htroot/index.java
Tue Dec 27 20:37:56 CET 2011
by Michael Christen
hint to open firewalls
Changed Files: readme.txt
Sun Dec 25 10:14:15 CET 2011
by Michael Christen
better lookup for peer names
Changed Files: htroot/IndexControlRWIs_p.java, source/net/yacy/peers/Seed.java, source/net/yacy/peers/SeedDB.java
Fri Dec 23 11:15:41 CET 2011
by databasedictionary
Translate by translated.by/neos and seven_ro
Changed Files: locales/ru.lng
Thu Dec 22 08:03:22 CET 2011
by databasedictionary
Translate to Russian (part 7/x)
Changed Files: locales/ru.lng
Thu Dec 22 07:52:03 CET 2011
by databasedictionary
Translate by translated.by/neos
Changed Files: locales/ru.lng
Wed Dec 21 10:23:54 CET 2011
by lofyer
a little mistake..
Changed Files: locales/cn.lng
Wed Dec 21 10:02:17 CET 2011
by lofyer
fixed: missing page in Crawler_p.html in Chinese
Changed Files: locales/cn.lng
Wed Dec 21 07:49:38 CET 2011
by databasedictionary
Translate to Russian (part 6/x)
Changed Files: locales/ru.lng
Wed Dec 21 06:31:10 CET 2011
by databasedictionary
Translate by translated.by/neos
Changed Files: locales/ru.lng
Wed Dec 21 01:14:43 CET 2011
by Michael Christen
redesign of fining of peers by ip: more leightweight method to read the
seed databases
Changed Files: htroot/AccessTracker_p.java, htroot/Connections_p.java, htroot/yacy/search.java, source/net/yacy/peers/PeerActions.java, source/net/yacy/peers/SeedDB.java
Wed Dec 21 00:32:03 CET 2011
by Michael Christen
new handling of remote search processes: looking for seeds will now not
block the whole search process any more. A deadlock with a DHT selection
process may have been the cause for interface lockings in the past.
Changed Files: source/net/yacy/peers/RemoteSearch.java, source/net/yacy/peers/graphics/NetworkGraph.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SearchEventCache.java
Tue Dec 20 13:26:07 CET 2011
by lofyer
Chinese translation: all done
Changed Files: locales/cn.lng
Tue Dec 20 09:44:11 CET 2011
by databasedictionary
Translate to Russian (part 5/x)
Changed Files: locales/ru.lng
Tue Dec 20 08:50:42 CET 2011
by databasedictionary
Translate by translated.by/neos
Changed Files: locales/ru.lng
Sun Dec 18 16:07:51 CET 2011
by Michael Christen
more about CreativeCommons license vocabulary
Changed Files: source/net/yacy/cora/lod/vocabulary/CreativeCommons.java
Sun Dec 18 16:07:21 CET 2011
by Michael Christen
added language selector for russian and chinese in ConfigBasic
Changed Files: htroot/ConfigBasic.html, htroot/ConfigBasic.java
Sun Dec 18 12:18:40 CET 2011
by lofyer
till ViewFile.html
Changed Files: locales/cn.lng
Sun Dec 18 09:54:08 CET 2011
by Michael Christen
less dramatic upnp failures
Changed Files: source/net/yacy/upnp/DiscoveryListener.java
Sun Dec 18 08:19:48 CET 2011
by Michael Christen
the component part in the YaCy Metadata is filled using the Dubling Core
vocabulary
Changed Files: source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java
Sat Dec 17 02:43:05 CET 2011
by lofyer
till SettingsAck_p.html
Changed Files: locales/cn.lng
Sat Dec 17 02:03:45 CET 2011
by Michael Christen
added vocabulary for geolocalization as used in georss
Changed Files: source/net/yacy/cora/lod/vocabulary/Geo.java
Sat Dec 17 01:09:16 CET 2011
by Michael Christen
added rdf vocabulary
Changed Files: source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java, source/net/yacy/cora/storage/MapStore.java
Fri Dec 16 23:01:47 CET 2011
by Michael Peter Christen
added a Triple Store based on Nodes that fit to the new storage classes.
Added also a first Vocabulary for the node store - Dublin Core.
Changed Files: source/net/yacy/cora/lod/Node.java, source/net/yacy/cora/lod/TripleStore.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Vocabulary.java
Fri Dec 16 23:00:50 CET 2011
by Michael Peter Christen
added BEncodedHeapBag and BEncodedHeapShard which are storage container
for a new metadata store. An abstraction of the content for this storage
is defined with MapStore. A MapStore is an abstraction of a RDF Node
store.
Changed Files: source/net/yacy/kelondro/blob/AbstractMapStore.java, source/net/yacy/kelondro/blob/BEncodedHeap.java, source/net/yacy/kelondro/blob/BEncodedHeapBag.java, source/net/yacy/kelondro/blob/BEncodedHeapShard.java, source/net/yacy/kelondro/blob/MapStore.java
Thu Dec 15 23:33:41 CET 2011
by Michael Christen
one more performance hack to prevent costly md5 computation
Changed Files: source/net/yacy/kelondro/order/Digest.java
Thu Dec 15 17:45:46 CET 2011
by Michael Christen
better digest pool size (smaller by default but unlimited)
Changed Files: source/net/yacy/kelondro/order/Digest.java
Thu Dec 15 14:13:04 CET 2011
by lofyer
till PerformanceMemory_p.html
Changed Files: locales/cn.lng
Thu Dec 15 07:13:14 CET 2011
by databasedictionary
Translate to Russian (part 4/x)
Changed Files: locales/ru.lng
Wed Dec 14 17:33:18 CET 2011
by Michael Peter Christen
added phonetic classes
Changed Files: source/net/yacy/cora/language/phonetic/ColognePhonetic.java, source/net/yacy/cora/language/phonetic/DoubleMetaphone.java, source/net/yacy/cora/language/phonetic/Metaphone.java, source/net/yacy/cora/language/phonetic/Phonetic.java, source/net/yacy/cora/language/phonetic/Soundex.java, source/net/yacy/cora/plugin/ClassProvider.java
Wed Dec 14 07:47:23 CET 2011
by databasedictionary
Translate to Russian (part 3/x)
Changed Files: locales/ru.lng
Tue Dec 13 13:17:20 CET 2011
by lofyer
till DictionaryLoader_p.html
Changed Files: locales/cn.lng
Tue Dec 13 07:59:22 CET 2011
by databasedictionary
Translate to Russian (part 2/x)
Changed Files: locales/ru.lng
Tue Dec 13 06:53:07 CET 2011
by databasedictionary
Russian translate (part 1/x)
Changed Files: locales/ru.lng
Mon Dec 12 13:54:17 CET 2011
by lofyer
till IndexCleaner_p.html
Changed Files: locales/cn.lng
Sun Dec 11 22:42:55 CET 2011
by apfelmaennchen
work around for overflow in YMarks.html import tab
Changed Files: htroot/YMarks.html
Sun Dec 11 13:34:26 CET 2011
by Michael Christen
the changelog is completely outdated and therefore confusing. Anyone who
wants to have an up-to date changelog is called to make one.
Changed Files:
Sat Dec 10 14:01:45 CET 2011
by lofyer
a little mistake
Changed Files: locales/cn.lng
Sat Dec 10 13:03:58 CET 2011
by lofyer
checked till CrawlResults.html
Changed Files: locales/cn.lng
Sat Dec 10 12:31:34 CET 2011
by lofyer
ok now
Changed Files: locales/cn.lng
Sat Dec 10 12:25:36 CET 2011
by lofyer
one line in the file I did not understand well, so I marked it
Changed Files: locales/cn.lng
Sat Dec 10 02:04:36 CET 2011
by Michael Christen
added "about" box configuration 
Changed Files: htroot/ConfigPortal.html, htroot/ConfigPortal.java
Fri Dec 09 07:49:05 CET 2011
by lofyer
till ConfigSearchBox.html. some of the #info are not translated until last proved that they are clean
Changed Files: locales/cn.lng
Thu Dec 08 22:29:06 CET 2011
by admin
fixed ant build for deb target: no more svn numbers
Changed Files: build.xml
Thu Dec 08 18:48:30 CET 2011
by Michael Peter Christen
stop words are on by default in site crawl. This causes normally nothing
since the stopwords are empty by default.
Changed Files: htroot/CrawlStartSite_p.html
Thu Dec 08 12:09:41 CET 2011
by lofyer
checked and modified some mistake till ConfigLiveSearch.html
Changed Files: locales/cn.lng
Thu Dec 08 11:16:51 CET 2011
by lofyer
change some #info
Changed Files: locales/cn.lng
Thu Dec 08 10:25:26 CET 2011
by Michael Christen
translator updates:
- config string for chinese
- do not copy the language file to DATA/LOCALE any more (and do not use
them there, this is really confusing for new translators)
Changed Files: defaults/yacy.init, htroot/ConfigBasic.java, htroot/ConfigLanguage_p.java, source/de/anomic/data/Translator.java, source/net/yacy/yacy.java
Thu Dec 08 09:44:53 CET 2011
by lofyer
new
Changed Files: htroot/ConfigBasic.java, locales/cn.lng
Wed Dec 07 13:01:28 CET 2011
by lofyer
Status must be #ed because of translation.
Changed Files: locales/cn.lng
Wed Dec 07 12:42:04 CET 2011
by lofyer
add cn.lng
Changed Files: locales/cn.lng
Wed Dec 07 04:20:49 CET 2011
by sixcooler
Revision 9000+ hack
do not handle the revision in build.properties anymore
(9000 as fallback)
build-date from git-HEAD (instead when build is fired)
(orginal build-date as fallback)
Changed Files: build.properties, build.xml, libbuild/GitRevTask/GitRevTask.java
Wed Dec 07 01:03:08 CET 2011
by Michael Christen
release 1.01 - now with virtual svn number 9000
Changed Files: build.properties, build.xml
Wed Dec 07 01:02:23 CET 2011
by Michael Christen
bad initialization
Changed Files: source/net/yacy/kelondro/blob/HeapReader.java
Wed Dec 07 00:32:42 CET 2011
by Michael Christen
protection against too long running snippet fetch processes
Changed Files: source/de/anomic/http/client/Cache.java, source/net/yacy/search/query/SnippetProcess.java
Wed Dec 07 00:17:57 CET 2011
by apfelmaennchen
bugfix for YMarks XBEL import and export; thanks to Dominic

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8138 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/YMarks.html, htroot/api/ymarks/get_xbel.java, source/de/anomic/data/ymark/YMarkEntry.java, source/de/anomic/data/ymark/YMarkXBELImporter.java
Tue Dec 06 22:04:34 CET 2011
by Michael Christen
less io operations
Changed Files: source/net/yacy/kelondro/table/SplitTable.java
Tue Dec 06 21:55:50 CET 2011
by Michael Christen
ups
Changed Files: source/net/yacy/search/query/RWIProcess.java
Tue Dec 06 15:18:02 CET 2011
by Michael Christen
removed translations for help page (the same content is not there any
more because it was old and unappropriate)
Changed Files: locales/fr.lng, locales/gr.lng, locales/it.lng, locales/sk.lng
Tue Dec 06 11:37:37 CET 2011
by Michael Christen
less terrible warning if uPnP fails
Changed Files: source/net/yacy/upnp/DiscoveryAdvertisement.java
Tue Dec 06 11:37:05 CET 2011
by Michael Christen
showing /16 and /24 subnet option instead of 'bigrange' in network
scanner
Changed Files: htroot/CrawlStartScanner_p.html, htroot/CrawlStartScanner_p.java
Tue Dec 06 02:53:30 CET 2011
by Michael Christen
added YBR computation process as servlet
Changed Files: htroot/YBRFetch_p.html, htroot/YBRFetch_p.java
Tue Dec 06 02:49:58 CET 2011
by sixcooler
probably fix for http://bugs.yacy.net/view.php?id=94
(don't know how to force this exception)
Changed Files: source/net/yacy/kelondro/util/GenerationMemoryStrategy.java
Tue Dec 06 02:24:51 CET 2011
by Michael Christen
better ranking because we wait a very little time during the search
process more to get better remote sear results into the ranking priority
stack
Changed Files: htroot/IndexControlRWIs_p.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java
Tue Dec 06 02:21:40 CET 2011
by Michael Christen
fixed localization dictionaries, see
http://forum.yacy-websuche.de/viewtopic.php?f=5&t=3418&view=next
Changed Files: source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/GeonamesLocalization.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java
Tue Dec 06 00:56:45 CET 2011
by suessthomas
Fix for http://bugs.yacy.net/view.php?id=93, Added a link to Bugtracker on YaCy Webinterface.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8137 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/env/templates/header.template
Mon Dec 05 23:37:49 CET 2011
by Michael Christen
removed npe
Changed Files: source/net/yacy/kelondro/blob/BEncodedHeap.java
Mon Dec 05 16:22:11 CET 2011
by Michael Christen
- less automatic indexing after a search (needs to reset the default
crawl profiles)
- fix for concurrency problem in storage of serverSwitch Properties
- markup update
Changed Files: source/de/anomic/crawler/CrawlSwitchboard.java, source/de/anomic/server/serverSwitch.java, source/net/yacy/kelondro/util/FileUtils.java, source/net/yacy/peers/graphics/WebStructureGraph.java
Mon Dec 05 15:45:33 CET 2011
by Michael Christen
less frequent DHT distribution to reduce the load a bit on every peer
Changed Files: defaults/yacy.init
Mon Dec 05 12:51:13 CET 2011
by Michael Christen
class path for servlets in eclipse
Changed Files: .classpath
Mon Dec 05 11:52:24 CET 2011
by Michael Christen
now that the whole world knows that we actually do p2p and not
metasearch we can support a default look-up to scroogle to gain more
attention to people who say that your search results are incomplete
Changed Files: defaults/yacy.init
Sun Dec 04 21:28:25 CET 2011
by david
Revert "Revert "revert test""

This reverts commit 22af9e3b66562091e1ef0fba6e3954e96697c9de.
Changed Files:
Sun Dec 04 21:28:17 CET 2011
by david
Revert "revert test"

This reverts commit 6ce3e517b72aa604c16fcd93956bb44aede87b2f.
Changed Files: gittest
Sun Dec 04 21:27:39 CET 2011
by david
revert test
Changed Files:
Sun Dec 04 21:21:59 CET 2011
by david
testing how it works...
Changed Files: gittest
Sun Dec 04 14:43:35 CET 2011
by low012
Improved CGI capabilities:
*) CGI respects shebang now (should solve problems with MS Windows)
*) better error handling (more correct HTTP error codes)
*) logging

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8136 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java
Sun Dec 04 08:22:13 CET 2011
by orbiter
changed ording on release files: main criteria is not the svn any more; releases are now ordered by
- release number
- date
- svn number

additionally there is a new option to remove the svn number completely

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8135 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/ConfigUpdate_p.java, readme.txt, source/net/yacy/peers/operation/yacyRelease.java, source/net/yacy/peers/operation/yacyVersion.java
Sat Dec 03 16:13:19 CET 2011
by daburna
First Green localization by Constantine Mousafiris
Changed Files: locales/gr.lng
Sat Dec 03 15:50:10 CET 2011
by daburna
I am back with a small update for the German translation
Changed Files: build.properties, locales/de.lng
Sat Dec 03 01:27:01 CET 2011
by orbiter
added an option in the bookmark import process to put everything into the crawler

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8134 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/Crawler_p.java, htroot/YMarks.html, htroot/api/ymarks/import_ymark.java, source/de/anomic/crawler/CrawlProfile.java
Sat Dec 03 01:07:07 CET 2011
by apfelmaennchen
Added nice jquery tagsinput to bookmarks dialog - similar to delicious.com ;-)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8133 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/YMarks.html, htroot/env/yacy-ymarks.css, htroot/jquery/css/jquery.tagsinput.css, htroot/jquery/js/jquery.tagsinput.min.js, htroot/js/yacy-ymarks-bookmark-actions.js, htroot/js/yacy-ymarks.js
Sat Dec 03 00:24:40 CET 2011
by apfelmaennchen
- small bug fix to ymarks html importer
- import of delicious.com exports has successfully been tested

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8132 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: source/de/anomic/data/ymark/YMarkHTMLImporter.java
Fri Dec 02 10:43:34 CET 2011
by apfelmaennchen
small change to mouse over text for  crawl starts within bookmarks

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8131 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/api/ymarks/get_ymark.java
Fri Dec 02 10:16:24 CET 2011
by orbiter
- search bugfixes (page counter and number of results per page; recognition of new search)
- experiments to speed-up the network image production (commented out)


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8130 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/index.html, htroot/index.java, htroot/yacysearch.java, source/net/yacy/peers/graphics/NetworkGraph.java
Fri Dec 02 02:36:03 CET 2011
by sixcooler
the timeout of httpclient is not absolut, but till a connection is
established or between bytes send
trying this to reduce count of client-connections to /yacy/search.html
of other peers
Changed Files: source/net/yacy/peers/Protocol.java
Fri Dec 02 00:51:39 CET 2011
by hermens
Fix for PeerSelection.seedsByAge() for big networks (>1000 Peers)
To get the most(least) recent peers search those with highest(lowest) LastSeen instead of the first by peerhash


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8129 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: source/net/yacy/peers/dht/PeerSelection.java
Thu Dec 01 23:25:23 CET 2011
by apfelmaennchen


git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8128 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: source/de/anomic/data/ymark/YMarkEntry.java, source/de/anomic/data/ymark/YMarkHTMLImporter.java
Thu Dec 01 21:57:22 CET 2011
by orbiter
fix for http://bugs.yacy.net/view.php?id=78

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8127 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: source/net/yacy/kelondro/blob/ArrayStack.java, source/net/yacy/kelondro/blob/MapHeap.java
Thu Dec 01 12:30:14 CET 2011
by Al Sutton
Added try/finally protection to ensure streams are closed. Added initial size guess for the CharBuffer
Changed Files: source/net/yacy/document/parser/ooxmlParser.java
Thu Dec 01 12:28:52 CET 2011
by Al Sutton
Added try/finally protection to ensure streams are closed. Added initial size guess for the CharBuffer
Changed Files: source/net/yacy/document/parser/odtParser.java
Thu Dec 01 12:25:59 CET 2011
by Al Sutton
Added close() to ensure buffer close actions are invoked
Changed Files: source/net/yacy/document/parser/html/TransformerWriter.java
Thu Dec 01 12:20:13 CET 2011
by Al Sutton
Allow initial buffer size definition in TransformWriter, and use available() method to set it in htmlParser. In this situation a ByteArrayInputStream is used so the available() method gives a good size estimation and avoid the buffer needing to be continually grown
Changed Files: source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/document/parser/htmlParser.java
Thu Dec 01 12:11:13 CET 2011
by Al Sutton
Added missing closure of ByteArrayInputSteam
Changed Files: source/net/yacy/document/TextParser.java
Wed Nov 30 23:06:13 CET 2011
by orbiter
- some speed hacks for network image
- panic patch for 'AD' hashes until it is clear where the problem comes from

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8126 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: source/net/yacy/peers/Seed.java, source/net/yacy/peers/graphics/NetworkGraph.java
Wed Nov 30 22:21:16 CET 2011
by orbiter
- faster ping to clean up old peers faster
- clean up more news

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8125 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: defaults/yacy.init, source/net/yacy/peers/NewsPool.java, source/net/yacy/search/Switchboard.java
Mon Nov 28 21:34:02 CET 2011
by orbiter
more...
(yes this does not scale unlimited)

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8123 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/Network.java
Mon Nov 28 14:36:51 CET 2011
by orbiter
fix for npe

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8122 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: source/net/yacy/search/query/SearchEvent.java
Sun Nov 27 23:11:39 CET 2011
by orbiter
fix for latest navigation feature...

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8121 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/yacysearch.java, htroot/yacysearchitem.html
Sun Nov 27 21:20:09 CET 2011
by orbiter
automatically activate checkbox for set-password if password field is activated to prevent user mistakes

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8120 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: htroot/ConfigAccounts_p.html
Sun Nov 27 20:29:35 CET 2011
by low012
*) added German translation of new description on index.html (from r8108)
*) a few small changes in the menu

HINT! HINT! HINT! Translation could be improved and there are probably lots of out-dated entries in the file.

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@8119 6c8d7289-2bf4-0310-a012-ef5d649a1542
Changed Files: locales/de.lng