YaCy Release 1.03

Release_1.03

Major Changes   
Jump to: Bugfixes / Other Changes

CommitDescription
Sun Jun 17 23:48:33 CEST 2012
by Michael Peter Christen
- merged files
- changed behaviour of delete button in vocabulary edit
- fixed size numbe in vocabulary listing
Changed Files: defaults/yacy.init, htroot/DemoServlet.java, htroot/DemoServletInteraction.java, htroot/DemoServletRDF.java, htroot/DictionaryLoader_p.java, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/api/yacydoc.java, htroot/interaction/Triple.java, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/server/serverSwitch.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeoLocation.java, source/net/yacy/document/geolocation/GeoPoint.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/IntegerGeoPoint.java, source/net/yacy/document/geolocation/Locations.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java, source/net/yacy/document/importer/OAIPMHLoader.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/yacy.java
Sun Jun 17 23:07:00 CEST 2012
by cominch
Merge remote-tracking branch 'original yacy/master'
Changed Files: defaults/yacy.init, htroot/DemoServlet.java, htroot/DemoServletInteraction.java, htroot/DemoServletRDF.java, htroot/DictionaryLoader_p.java, htroot/ViewFile.html, htroot/ViewFile.java, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/api/yacydoc.html, htroot/api/yacydoc.java, htroot/api/yacydoc.xml, htroot/interaction/Triple.java, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/server/serverSwitch.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeoLocation.java, source/net/yacy/document/geolocation/GeoPoint.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/IntegerGeoPoint.java, source/net/yacy/document/geolocation/Locations.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java, source/net/yacy/document/importer/OAIPMHLoader.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/yacy.java
Sun Jun 17 11:22:08 CEST 2012
by Michael Peter Christen
removed warnings/unused entities
Changed Files: htroot/DemoServlet.java, htroot/DemoServletInteraction.java, htroot/DemoServletRDF.java, htroot/api/yacydoc.java, htroot/interaction/Triple.java, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/interaction/Interaction.java
Sat Jun 16 22:09:32 CEST 2012
by Michael Peter Christen
refactoring (geolocalzation -> geolocation)
Changed Files: htroot/DictionaryLoader_p.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeoLocation.java, source/net/yacy/document/geolocation/GeoPoint.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/IntegerGeoPoint.java, source/net/yacy/document/geolocation/Locations.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java
Thu Jun 14 11:43:22 CEST 2012
by cominch
Merge remote-tracking branch 'original yacy/master'
Changed Files: .classpath, htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsing_p.html, htroot/AugmentedParsing_p.html, htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, htroot/IndexControlRWIs_p.html, htroot/IndexControlRWIs_p.java, htroot/Triple_p.html, htroot/Triple_p.java, htroot/Triplestore_p.html, htroot/User.html, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuConfig.template, htroot/env/templates/submenuSemantic.template, htroot/interaction/GetRDF.java, htroot/interaction/PutRDF.java, htroot/js/Crawler.js, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchtrailer.java, nbproject/project.xml, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/MapTripleStore.java, source/net/yacy/cora/lod/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/CreativeCommons.java, source/net/yacy/cora/lod/vocabulary/DCTerms.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Foaf.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Owl.java, source/net/yacy/cora/lod/vocabulary/Rdf.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/Parser.java, source/net/yacy/document/TextParser.java, source/net/yacy/document/geolocalization/GeonamesLocation.java, source/net/yacy/document/geolocalization/Locations.java, source/net/yacy/document/geolocalization/OpenGeoDBLocation.java, source/net/yacy/document/geolocalization/OverarchingLocation.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/bzipParser.java, source/net/yacy/document/parser/csvParser.java, source/net/yacy/document/parser/docParser.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/document/parser/genericParser.java, source/net/yacy/document/parser/gzipParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/images/genericImageParser.java, source/net/yacy/document/parser/mmParser.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/document/parser/pdfParser.java, source/net/yacy/document/parser/pptParser.java, source/net/yacy/document/parser/psParser.java, source/net/yacy/document/parser/rdfParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java, source/net/yacy/document/parser/rssParser.java, source/net/yacy/document/parser/rtfParser.java, source/net/yacy/document/parser/sevenzipParser.java, source/net/yacy/document/parser/sidAudioParser.java, source/net/yacy/document/parser/sitemapParser.java, source/net/yacy/document/parser/swfParser.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/document/parser/torrentParser.java, source/net/yacy/document/parser/vcfParser.java, source/net/yacy/document/parser/vsdParser.java, source/net/yacy/document/parser/xlsParser.java, source/net/yacy/document/parser/zipParser.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/kelondro/data/meta/MetadataVocabulary.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/yacy.java
Thu Jun 14 09:44:14 CEST 2012
by Michael Peter Christen
- renamed localization to location (that was confusing)
- renamed 'Locale' navigator to 'Location'
- produce Location navigation only if geolocation libraries are loaded
Changed Files: htroot/DictionaryLoader_p.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/GeonamesLocalization.java, source/net/yacy/document/geolocalization/Locations.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java, source/net/yacy/document/geolocalization/OverarchingLocalization.java
Tue Jun 12 14:23:51 CEST 2012
by Michael Peter Christen
- using http://purl.org/dc/terms/references to refer from an
auto-annotated document to a 'pseudo-linked' document which has an url
created with an object-prefix as defined in the vocabulary file
Changed Files: source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/CreativeCommons.java, source/net/yacy/cora/lod/vocabulary/DCTerms.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Foaf.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Owl.java, source/net/yacy/cora/lod/vocabulary/Rdf.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/kelondro/data/meta/MetadataVocabulary.java
Mon Jun 11 23:49:30 CEST 2012
by Michael Peter Christen
changed behavior of navigation processing:
- vocabulary annotation is not done any more into the metadata of urldb
- vocabularies are written into the jena triplestore using a rdf
vocabulary
- vocabularies for rdf tripel must be updated; refactoring done
- with the new navigation tags in the triplestore a faster
pre-urldb-lookup is possible: navigation is processed now within the RWI
during pre-ranking retrieval
- added also a Owl vocabulary stub to add the plain-text url to the
triplestore using the owl:sameas predicate
Changed Files: htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/Vocabulary.java, source/net/yacy/cora/lod/vocabulary/CreativeCommons.java, source/net/yacy/cora/lod/vocabulary/DublinCore.java, source/net/yacy/cora/lod/vocabulary/Foaf.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Owl.java, source/net/yacy/cora/lod/vocabulary/Rdf.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/kelondro/data/meta/MetadataVocabulary.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java
Mon Jun 11 16:48:53 CEST 2012
by Michael Peter Christen
- moved triple store to net.yacy.cora.lod (should be generalized there
later
- added abstract add, delete, get methods in the triplestore
- added generation of triples after auto-annotation
- migrated all MultiProtocolURI objects to DigestURI in the parser since
the url hash is needed as subject value in the triples in the triple
store
Changed Files: .classpath, htroot/Triple_p.java, htroot/User.html, htroot/interaction/GetRDF.java, htroot/interaction/PutRDF.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/MapTripleStore.java, source/net/yacy/cora/lod/SimpleVocabulary.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/document/Parser.java, source/net/yacy/document/TextParser.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/bzipParser.java, source/net/yacy/document/parser/csvParser.java, source/net/yacy/document/parser/docParser.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/document/parser/genericParser.java, source/net/yacy/document/parser/gzipParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/images/genericImageParser.java, source/net/yacy/document/parser/mmParser.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/document/parser/pdfParser.java, source/net/yacy/document/parser/pptParser.java, source/net/yacy/document/parser/psParser.java, source/net/yacy/document/parser/rdfParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java, source/net/yacy/document/parser/rdfa/main.java, source/net/yacy/document/parser/rssParser.java, source/net/yacy/document/parser/rtfParser.java, source/net/yacy/document/parser/sevenzipParser.java, source/net/yacy/document/parser/sidAudioParser.java, source/net/yacy/document/parser/sitemapParser.java, source/net/yacy/document/parser/swfParser.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/document/parser/torrentParser.java, source/net/yacy/document/parser/vcfParser.java, source/net/yacy/document/parser/vsdParser.java, source/net/yacy/document/parser/xlsParser.java, source/net/yacy/document/parser/zipParser.java, source/net/yacy/interaction/Interaction.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/yacy.java
Mon Jun 11 00:17:30 CEST 2012
by Roland 'Quix0r' Haeder
Rewrote all String blacklist types to enum 'BlacklistType', closes bug
#143

Conflicts:
	htroot/Supporter.java
	htroot/yacy/crawlReceipt.java
	htroot/yacy/transferRWI.java
	htroot/yacy/transferURL.java
	source/de/anomic/crawler/CrawlStacker.java
	source/de/anomic/data/ListManager.java
	source/net/yacy/peers/Protocol.java
	source/net/yacy/repository/Blacklist.java
	source/net/yacy/repository/LoaderDispatcher.java
	source/net/yacy/search/Switchboard.java
	source/net/yacy/search/index/MetadataRepository.java
	source/net/yacy/search/index/Segment.java
	source/net/yacy/search/query/RWIProcess.java
	source/net/yacy/search/snippet/MediaSnippet.java
Changed Files: htroot/BlacklistCleaner_p.java, htroot/BlacklistTest_p.java, htroot/Blacklist_p.java, htroot/IndexControlRWIs_p.java, htroot/Supporter.java, htroot/Surftips.java, htroot/api/blacklists_p.java, htroot/sharedBlacklist_p.java, htroot/yacy/crawlReceipt.java, htroot/yacy/transferRWI.java, htroot/yacy/transferURL.java, source/de/anomic/crawler/CrawlStacker.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/data/ListManager.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/peers/NewsPool.java, source/net/yacy/peers/Protocol.java, source/net/yacy/repository/Blacklist.java, source/net/yacy/repository/BlacklistFile.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/MetadataRepository.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/snippet/MediaSnippet.java
Sun Jun 10 23:33:09 CEST 2012
by cominch
- removed unused variables
- do not replace malformed or invalid URLs in urlproxy

git-svn-id: https://svn.berlios.de/svnroot/repos/yacy/trunk@7835
6c8d7289-2bf4-0310-a012-ef5d649a1542

Conflicts:
	source/de/anomic/http/server/HTTPDFileHandler.java
Changed Files: htroot/Triple_p.java, htroot/interaction/GetRDF.java, htroot/interaction/PutRDF.java, htroot/interaction/Table.java, htroot/interaction/Triple.java, htroot/interaction/UploadSingleFile.java, source/de/anomic/http/server/AugmentedHtmlStream.java, source/de/anomic/http/server/HTTPDProxyHandler.java
Sun Jun 10 10:42:33 CEST 2012
by cominch
Add several parsers, for RDFa and rdf files.

Conflicts:
	source/net/yacy/document/TextParser.java
Changed Files: RDFaParser/RDFaParser.xsl, htroot/interaction/OverlayInteraction.html, source/net/yacy/document/TextParser.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/rdfParser.java, source/net/yacy/document/parser/rdfa/IRDFaTriple.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaTripleContent.java, source/net/yacy/document/parser/rdfa/impl/RDFaTripleImpl.java, source/net/yacy/document/parser/rdfa/main.java
Sun Jun 10 10:35:59 CEST 2012
by cominch
Add Triplestore and RDF query interface

Conflicts:
	build.xml
	defaults/yacy.init
	source/net/yacy/interaction/AugmentHtmlStream.java
Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, defaults/yacy.init, htroot/Triple_p.html, htroot/Triple_p.java, htroot/interaction/OverlayInteraction.html, htroot/interaction/OverlayInteraction.java, lib/arq-2.8.7.jar, lib/iri-0.8.jar, lib/jena-2.6.4.jar, lib/sax-2.0.1.jar, source/net/yacy/interaction/AugmentHtmlStream.java
Tue Jun 05 20:03:43 CEST 2012
by Michael Peter Christen
removed warnings
Changed Files: htroot/sharedBlacklist_p.java, source/de/anomic/crawler/CrawlProfile.java, source/de/anomic/crawler/CrawlStacker.java, source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java, source/net/yacy/document/content/dao/ImportDump.java, source/net/yacy/document/importer/OAIListFriendsLoader.java, source/net/yacy/kelondro/blob/MapColumnIndex.java, source/net/yacy/kelondro/util/ByteArray.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java
Tue Jun 05 12:06:26 CEST 2012
by Michael Peter Christen
performance hacks
Changed Files: htroot/IndexControlRWIs_p.java, htroot/yacysearch.java, source/de/anomic/tools/crypt.java, source/net/yacy/kelondro/rwi/AbstractIndex.java, source/net/yacy/kelondro/rwi/Index.java, source/net/yacy/kelondro/rwi/IndexCell.java, source/net/yacy/kelondro/rwi/ReferenceContainerCache.java, source/net/yacy/peers/dht/Dispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SearchEventCache.java
Mon Jun 04 15:37:39 CEST 2012
by Michael Peter Christen
- performance hacks
- added log warnings in case that search processes run into time-out
situations
- better concurrency for Integer formatter (used a non-synchronized
formatter before)
- bugfix for search termination (a poison pill was missing)
- added timeout parameters for search (again) -> target is, that they
are never reached.
Changed Files: htroot/AccessTracker_p.java, htroot/yacy/search.java, htroot/yacysearch.java, source/de/anomic/data/ymark/YMarkAutoTagger.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/parser/torrentParser.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/kelondro/index/RowSet.java, source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java, source/net/yacy/kelondro/logging/ConsoleOutHandler.java, source/net/yacy/kelondro/util/Formatter.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/AccessTracker.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/ranking/ReferenceOrder.java
Thu May 31 22:39:53 CEST 2012
by Michael Peter Christen
ehanced location search:
- search request are now made using a map boundary
- search results are only computed for the map boundary
- the number of results is adopted to the results in the visible range
- added a double-buffering for the search result markers
- added a search query option for the search results:
/radius/<lat>/<lon>/<radius>
Changed Files: htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearch_location.html, htroot/yacysearch_location.java, source/de/anomic/crawler/ResultURLs.java, source/de/anomic/server/serverObjects.java, source/net/yacy/cora/services/federated/solr/SolrDoc.java, source/net/yacy/document/Document.java, source/net/yacy/document/content/DCEntry.java, source/net/yacy/document/content/dao/PhpBB3Dao.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/kelondro/data/meta/URIMetadata.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/index/SolrConfiguration.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/ResultEntry.java
Wed May 30 16:59:13 CEST 2012
by Michael Peter Christen
performance hack: use a hash cache for all hashes that are computed by a
byte array. If this hash is used in a HashMap (which is very often the
case) then this hack eliminates a lot of re-computations of the same
hash.
Changed Files: source/net/yacy/kelondro/data/citation/CitationReference.java, source/net/yacy/kelondro/data/image/ImageReferenceRow.java, source/net/yacy/kelondro/data/image/ImageReferenceVars.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/kelondro/data/word/WordReferenceRow.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/kelondro/util/ByteArray.java, source/net/yacy/search/snippet/MediaSnippet.java, source/net/yacy/search/snippet/ResultEntry.java, source/net/yacy/search/snippet/TextSnippet.java
Wed May 30 14:46:21 CEST 2012
by sixcooler
bump to httpclient- httpcore-, httpmime- 4.2
Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, lib/httpclient-4.2.License, lib/httpclient-4.2.jar, lib/httpcore-4.2.License, lib/httpcore-4.2.jar, lib/httpmime-4.2.License, lib/httpmime-4.2.jar, nbproject/project.xml, source/net/yacy/cora/protocol/http/HTTPClient.java
Mon May 28 23:53:48 CEST 2012
by Michael Peter Christen
replaced old bzip2 library against better documented commons-compress
package from http://commons.apache.org/compress/
Changed Files: .classpath, .settings/org.eclipse.jdt.core.prefs, addon/YaCy.app/Contents/Info.plist, build.xml, lib/commons-compress-1.4.1.License, lib/commons-compress-1.4.1.jar, source/net/yacy/dbtest.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/bzipParser.java
Thu May 24 13:24:31 CEST 2012
by Michael Peter Christen
changed log-in text for all servlets with authentication:
- added hint how to set the password using a shell script
- added a shell script to change the password
Changed Files: bin/passwd.sh, htroot/Blog.java, htroot/BlogComments.java, htroot/Bookmarks.java, htroot/ConfigBasic.java, htroot/ConfigParser.java, htroot/ConfigPortal.java, htroot/CrawlResults.java, htroot/Network.java, htroot/News.java, htroot/Status.java, htroot/Steering.java, htroot/Supporter.java, htroot/Surftips.java, htroot/User.java, htroot/ViewFile.java, htroot/Wiki.java, htroot/api/bookmarks/posts/add_p.java, htroot/api/bookmarks/posts/delete_p.java, htroot/api/bookmarks/tags/getTag.java, htroot/api/bookmarks/xbel/xbel.java, htroot/api/ymarks/add_ymark.java, htroot/api/ymarks/delete_ymark.java, htroot/api/ymarks/get_metadata.java, htroot/api/ymarks/get_treeview.java, htroot/api/ymarks/get_xbel.java, htroot/api/ymarks/get_ymark.java, htroot/api/ymarks/import_ymark.java, htroot/api/ymarks/manage_tags.java, htroot/api/ynetSearch.java, htroot/index.java, htroot/yacysearch.java, source/de/anomic/data/ymark/YMarkTables.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/server/serverObjects.java, source/de/anomic/server/servletProperties.java
Mon May 21 17:52:30 CEST 2012
by Michael Peter Christen
add-on to latest commit
Changed Files: htroot/QuickCrawlLink_p.java, htroot/YaCySearchPluginFF.java, htroot/autoconfig.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/date/GenericFormatter.java, source/net/yacy/cora/protocol/HeaderFramework.java, source/net/yacy/cora/util/NumberTools.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/table/Relations.java, source/net/yacy/kelondro/util/OS.java, source/net/yacy/search/ranking/RankingProfile.java, source/net/yacy/search/snippet/MediaSnippet.java
Mon May 21 13:40:46 CEST 2012
by Michael Peter Christen
performance hack to parse numbers inside of substrings without actually
generating a substring. This avoids the allocation of a String object
ech time a substring is parsed. Should affect CPU load during RWI
transmission.
Changed Files: htroot/QuickCrawlLink_p.java, htroot/YaCySearchPluginFF.java, htroot/autoconfig.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/date/GenericFormatter.java, source/net/yacy/cora/protocol/HeaderFramework.java, source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/table/Relations.java, source/net/yacy/kelondro/util/NumberTools.java, source/net/yacy/search/ranking/RankingProfile.java, source/net/yacy/search/snippet/MediaSnippet.java
Mon May 21 03:03:47 CEST 2012
by Michael Peter Christen
added a "fromCache" flag in Response object to omit one cache.has()
check during snippet generation. This should cause less blockings
Changed Files: source/de/anomic/crawler/retrieval/FTPLoader.java, source/de/anomic/crawler/retrieval/FileLoader.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/crawler/retrieval/SMBLoader.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/snippet/TextSnippet.java
Sat May 19 01:06:33 CEST 2012
by Michael Peter Christen
bugfix to http://bugs.yacy.net/view.php?id=181
tried to make a bit less 'noise' to dns server

also included: less processes in snippet fetch to reduce load during
search on small computers
Changed Files: htroot/IndexControlURLs_p.java, htroot/yacysearchitem.java, source/de/anomic/crawler/CrawlStacker.java, source/de/anomic/data/ymark/YMarkUtil.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/peers/graphics/WebStructureGraph.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/SnippetProcess.java
Wed May 16 13:42:32 CEST 2012
by Michael Peter Christen
removed (not all) warnings
Changed Files: htroot/Banner.java, htroot/Table_API_p.java, htroot/yacysearchitem.java, source/de/anomic/data/ymark/YMarkAutoTagger.java, source/de/anomic/http/server/TemplateEngine.java, source/de/anomic/tools/loaderThreads.java, source/net/yacy/cora/storage/ConfigurationSet.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/kelondro/logging/ThreadDump.java, source/net/yacy/peers/graphics/NetworkGraph.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/yacy.java
Tue May 15 22:34:02 CEST 2012
by reger
Add possibility to set custom Solr field names for the YaCy default Solr attributes.
- Changing the format of YaCy's solr.key.list while maintainig backward compatibility
  Federated index config screens adjusted accordingly
- modified the Solr update request to use a 3 min Solr autocommit intervall
Changed Files: htroot/IndexFederated_p.html, htroot/IndexFederated_p.java, htroot/api/schema_p.java, htroot/api/schema_p.xml, source/net/yacy/cora/services/federated/solr/SolrDoc.java, source/net/yacy/cora/services/federated/solr/SolrField.java, source/net/yacy/cora/services/federated/solr/SolrShardingSelection.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/cora/storage/ConfigurationSet.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrConfiguration.java, source/net/yacy/search/index/SolrField.java, source/net/yacy/search/query/SnippetProcess.java
Tue May 15 13:13:07 CEST 2012
by Michael Peter Christen
added missing serialization to remove all warnings
Changed Files: source/net/yacy/kelondro/data/citation/CitationReference.java, source/net/yacy/kelondro/data/citation/CitationReferenceFactory.java, source/net/yacy/kelondro/data/image/ImageReferenceFactory.java, source/net/yacy/kelondro/data/image/ImageReferenceVars.java, source/net/yacy/kelondro/data/navigation/NavigationReferenceFactory.java, source/net/yacy/kelondro/data/navigation/NavigationReferenceVars.java, source/net/yacy/kelondro/data/word/WordReferenceFactory.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/order/Bitfield.java, source/net/yacy/kelondro/rwi/ReferenceContainer.java, source/net/yacy/peers/graphics/WebStructureGraph.java
Tue May 15 12:55:15 CEST 2012
by Michael Peter Christen
made HandleSet serializable
Changed Files: .classpath, source/net/yacy/cora/order/ByteOrder.java, source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/HandleSet.java, source/net/yacy/kelondro/index/Row.java, source/net/yacy/kelondro/index/RowCollection.java, source/net/yacy/kelondro/index/RowSet.java, source/net/yacy/kelondro/order/Base64Order.java, source/net/yacy/kelondro/order/NaturalOrder.java, source/net/yacy/kelondro/order/StringOrder.java
Mon May 14 07:41:55 CEST 2012
by Roland 'Quix0r' Haeder
Now used synchronization in all close() methods to make sure all objects
are 'closed' in an ordered way

Conflicts:
	source/de/anomic/http/server/ChunkedInputStream.java
	source/de/anomic/http/server/ChunkedOutputStream.java
	source/de/anomic/http/server/ContentLengthInputStream.java
	source/net/yacy/cora/protocol/Domains.java
	source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java
	source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
	source/net/yacy/document/content/dao/PhpBB3Dao.java
	source/net/yacy/document/parser/html/AbstractTransformer.java
	source/net/yacy/kelondro/blob/BEncodedHeap.java
	source/net/yacy/kelondro/blob/HeapReader.java
	source/net/yacy/kelondro/index/RAMIndexCluster.java
	source/net/yacy/kelondro/io/ByteCountInputStream.java
	source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java
	source/net/yacy/kelondro/table/SQLTable.java
Changed Files: source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/CrawlStacker.java, source/de/anomic/crawler/CrawlSwitchboard.java, source/de/anomic/crawler/NoticedURL.java, source/de/anomic/data/BlogBoard.java, source/de/anomic/data/BlogBoardComments.java, source/de/anomic/data/BookmarkDate.java, source/de/anomic/data/BookmarksDB.java, source/de/anomic/data/MessageBoard.java, source/de/anomic/data/UserDB.java, source/de/anomic/data/wiki/WikiBoard.java, source/de/anomic/http/server/ChunkedInputStream.java, source/de/anomic/http/server/ChunkedOutputStream.java, source/de/anomic/http/server/ContentLengthInputStream.java, source/de/anomic/server/serverCore.java, source/net/yacy/cora/lod/TripleStore.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/cora/storage/KeyList.java, source/net/yacy/cora/storage/ZIPReader.java, source/net/yacy/cora/storage/ZIPWriter.java, source/net/yacy/document/Document.java, source/net/yacy/document/SentenceReader.java, source/net/yacy/document/WordTokenizer.java, source/net/yacy/document/content/dao/DatabaseConnection.java, source/net/yacy/document/content/dao/ImportDump.java, source/net/yacy/document/content/dao/PhpBB3Dao.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/dwgParser.java, source/net/yacy/document/parser/html/AbstractTransformer.java, source/net/yacy/document/parser/html/ContentTransformer.java, source/net/yacy/document/parser/html/ScraperInputStream.java, source/net/yacy/kelondro/blob/BEncodedHeap.java, source/net/yacy/kelondro/blob/BEncodedHeapShard.java, source/net/yacy/kelondro/blob/HeapReader.java, source/net/yacy/kelondro/blob/Tables.java, source/net/yacy/kelondro/index/BufferedObjectIndex.java, source/net/yacy/kelondro/index/HandleMap.java, source/net/yacy/kelondro/index/RAMIndexCluster.java, source/net/yacy/kelondro/io/ByteCountInputStream.java, source/net/yacy/kelondro/io/CharBuffer.java, source/net/yacy/kelondro/logging/ConsoleOutErrHandler.java, source/net/yacy/kelondro/rwi/ReferenceContainerArray.java, source/net/yacy/kelondro/rwi/ReferenceContainerCache.java, source/net/yacy/kelondro/rwi/ReferenceIterator.java, source/net/yacy/kelondro/table/SQLTable.java, source/net/yacy/kelondro/util/XMLTables.java, source/net/yacy/peers/NewsDB.java, source/net/yacy/peers/NewsQueue.java, source/net/yacy/peers/graphics/WebStructureGraph.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/index/Segments.java, source/org/apache/tools/tar/TarBuffer.java, source/org/apache/tools/tar/TarInputStream.java, source/org/apache/tools/tar/TarOutputStream.java
Wed May 09 16:46:45 CEST 2012
by Michael Peter Christen
made the solr connection more generic
Changed Files: htroot/IndexFederated_p.java, htroot/api/schema_p.java, source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrField.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/cora/services/federated/solr/SolrType.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrField.java, source/net/yacy/search/index/SolrScheme.java, source/net/yacy/search/query/SnippetProcess.java
Tue Apr 24 16:07:03 CEST 2012
by Michael Peter Christen
- Redesigned crawler and parser to accept embedded links from the NOLOAD
queue and not from virtual documents generated by the parser.
- The parser now generates nice description texts for NOLOAD entries
which shall make it possible to find media content using the search
index and not using the media prefetch algorithm during search (which
was costly)
- Removed the media-search prefetch process from image search
Changed Files: source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/de/anomic/crawler/retrieval/Request.java, source/de/anomic/crawler/retrieval/Response.java, source/net/yacy/document/Document.java, source/net/yacy/document/TextParser.java, source/net/yacy/document/importer/MediawikiImporter.java, source/net/yacy/document/parser/bzipParser.java, source/net/yacy/document/parser/gzipParser.java, source/net/yacy/document/parser/sevenzipParser.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/document/parser/zipParser.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java
Sun Apr 22 02:05:17 CEST 2012
by Michael Peter Christen
new indexing strategy: ALL links that appear anywhere are indexed, not
only links where the content can be parsed. All non-parseable links are
placed into the noload queue. The search process must therefore be able
to filter out non-text search results.
- This fixes the problem that image search results appeared in the text
search.
- The interactive search can retrieve now ALL types of links
- The p2p interface is now extended to retrieve only certain types of
links (text, image, video, apps)
- The search process has an extension to filter the right document type
according to the search query
Changed Files: htroot/js/yacyinteractive.js, htroot/yacy/search.java, htroot/yacyinteractive.html, htroot/yacysearch.java, htroot/yacysearchitem.java, source/de/anomic/crawler/CrawlStacker.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/document/Condenser.java, source/net/yacy/document/Document.java, source/net/yacy/peers/Protocol.java, source/net/yacy/peers/RemoteSearch.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java
Sun Apr 22 00:04:36 CEST 2012
by Michael Peter Christen
refactoring of ContentDomain: now subclass of Classification
Changed Files: htroot/Ranking_p.java, htroot/index.java, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEventCache.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/ranking/RankingProfile.java, source/net/yacy/search/snippet/MediaSnippet.java
Sat Apr 21 13:34:07 CEST 2012
by Michael Peter Christen
refactoring: the cache belongs to the crawler
Changed Files: htroot/CacheResource_p.java, htroot/ConfigHTCache_p.java, htroot/IndexControlRWIs_p.java, htroot/ProxyIndexingMonitor_p.java, htroot/ViewFile.java, source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/Cache.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/peers/graphics/OSMTile.java, source/net/yacy/repository/LoaderDispatcher.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/TextSnippet.java
Fri Apr 13 07:09:15 CEST 2012
by Michael Christen
added stub classes for
- a new database for url reference data ('seen links')
- a new database extending the references to the full url metadata
attributes set which shall replace the old metadata database if it is
finished
- migration help classes stub to use old and new metadata databases
simultanously
Changed Files: source/net/yacy/kelondro/data/meta/MetadataVocabulary.java, source/net/yacy/kelondro/data/meta/URIMetadata.java, source/net/yacy/kelondro/data/meta/URIMetadataNode.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/kelondro/data/meta/URIReference.java, source/net/yacy/kelondro/data/meta/URIReferenceNode.java, source/net/yacy/search/index/DocumentMetadata.java, source/net/yacy/search/index/DocumentReference.java, source/net/yacy/search/index/Metadata.java, source/net/yacy/search/index/MetadataMigration.java, source/net/yacy/search/index/MetadataRepository.java
Mon Feb 27 00:42:32 CET 2012
by Michael Peter Christen
ConcurrentLinkedQueue has a VERY long return time on the .size() method.
See
http://docs.oracle.com/javase/6/docs/api/java/util/concurrent/ConcurrentLinkedQueue.html

and the following test programm:

public class QueueLengthTimeTest {


    public static long countTest(Queue<Integer> q, int c) {
        long t = System.currentTimeMillis();
        for (int i = 0; i < c; i++) {
            q.add(q.size());
        }
        return System.currentTimeMillis() - t;
    }

    public static void main(String[] args) {
        int c = 1;
        for (int i = 0; i < 100; i++) {
            Runtime.getRuntime().gc();
            long t1 = countTest(new ArrayBlockingQueue<Integer>(c), c);
            Runtime.getRuntime().gc();
            long t2 = countTest(new LinkedBlockingQueue<Integer>(), c);
            Runtime.getRuntime().gc();
            long t3 = countTest(new ConcurrentLinkedQueue<Integer>(),
c);

            System.out.println("count = " + c + ": ArrayBlockingQueue =
" + t1 + ", LinkedBlockingQueue = " + t2 + ", ConcurrentLinkedQueue = "
+ t3);
            c = c * 2;
        }
    }
}
Changed Files: htroot/AccessTracker_p.java, source/de/anomic/crawler/ResultImages.java, source/de/anomic/crawler/ZURL.java, source/de/anomic/data/URLLicense.java, source/de/anomic/server/serverAccessTracker.java, source/net/yacy/kelondro/data/image/ImageReferenceVars.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/kelondro/util/EventTracker.java


Bugfixes   
Jump to: YaCy Release 1.03 top / Other Changes

CommitDescription
Tue Jun 19 08:23:10 CEST 2012
by Michael Peter Christen
enable asserts only with debugging
Changed Files: startYACY.sh
Tue Jun 19 07:44:44 CEST 2012
by Michael Peter Christen
fixed problem with seed when switching network
Changed Files: source/net/yacy/peers/SeedDB.java
Mon Jun 18 21:25:39 CEST 2012
by Michael Peter Christen
fix for npe, possibly for http://bugs.yacy.net/view.php?id=195
Changed Files: source/net/yacy/repository/LoaderDispatcher.java
Mon Jun 18 18:10:40 CEST 2012
by Michael Peter Christen
bugfix in vocabulary generation
Changed Files: htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java
Mon Jun 18 16:16:31 CEST 2012
by cominch
Augmented browsing: CSS fix
Changed Files: htroot/interaction_elements/Document_part.html, htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/Tag_part.html
Mon Jun 18 12:01:03 CEST 2012
by cominch
Augmented browsing: small UI fix
Changed Files: htroot/interaction_elements/Document_part.html, htroot/interaction_elements/Tag_part.html
Mon Jun 18 00:33:32 CEST 2012
by Michael Peter Christen
IPv6 bugfix
Changed Files: source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/peers/Seed.java
Sun Jun 17 17:18:19 CEST 2012
by Michael Peter Christen
fixed wrong parsing of style and script
Changed Files: source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/TransformerWriter.java
Sun Jun 17 11:08:33 CEST 2012
by Michael Peter Christen
fix for objectlink of PND vocabulary
Changed Files: source/net/yacy/document/LibraryProvider.java
Sat Jun 16 22:06:59 CEST 2012
by Michael Peter Christen
fix for OpenGeoDB loader
Changed Files: source/net/yacy/document/geolocalization/OpenGeoDBLocation.java
Sat Jun 16 13:12:02 CEST 2012
by Michael Peter Christen
fixed vocabulary initialization
Changed Files: htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java
Sat Jun 16 08:25:28 CEST 2012
by Michael Peter Christen
jquery bugfix
Changed Files: htroot/env/templates/jqueryheader.template, htroot/env/templates/metas.template, source/de/anomic/http/server/AugmentedHtmlStream.java, source/de/anomic/http/server/HTTPDProxyHandler.java
Thu Jun 14 18:05:10 CEST 2012
by cominch
hotfix for unresolved pattern
Changed Files: htroot/yacysearchitem.html
Thu Jun 14 17:56:38 CEST 2012
by cominch
hotfix until we have updated query routine for tags
Changed Files: htroot/yacysearchitem.java
Thu Jun 14 02:13:23 CEST 2012
by sixcooler
fix for reload-feature in Crawler_p
Changed Files: htroot/js/Crawler.js
Sun Jun 10 14:44:37 CEST 2012
by Michael Peter Christen
fix for autocomplete in index.html
Changed Files: htroot/index.html
Fri Jun 08 10:11:48 CEST 2012
by cominch
bugfix
Changed Files: source/net/yacy/document/Document.java
Wed Feb 15 15:30:53 CET 2012
by cominch
Small fix - return value of JSON should be empty
Changed Files: htroot/interaction/interaction.js
Wed Feb 15 14:13:15 CET 2012
by cominch
Quick fix
Changed Files: htroot/Triple_p.html
Sat Jun 09 10:59:45 CEST 2012
by Michael Peter Christen
bugfix in Domains - dns-lookup
Changed Files: source/net/yacy/cora/protocol/Domains.java
Fri Jun 08 17:14:09 CEST 2012
by Michael Peter Christen
fix for OOM
Changed Files: source/net/yacy/kelondro/table/Table.java
Fri Jun 08 10:20:43 CEST 2012
by Michael Peter Christen
npe bugfix
Changed Files: source/net/yacy/kelondro/order/MergeIterator.java
Thu Jun 07 12:36:05 CEST 2012
by Michael Peter Christen
fix for NPE in PerformanceMemory
Changed Files: htroot/PerformanceMemory_p.java
Wed Jun 06 18:23:18 CEST 2012
by Michael Peter Christen
a variety of possible memory leak fixes
Changed Files: source/net/yacy/cora/protocol/Domains.java, source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java, source/net/yacy/cora/storage/HashARC.java, source/net/yacy/cora/storage/KeyList.java, source/net/yacy/kelondro/index/HandleMap.java, source/net/yacy/kelondro/rwi/ReferenceContainerArray.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/TextSnippet.java
Wed Jun 06 14:13:31 CEST 2012
by Michael Peter Christen
fixes for bad long computation
Changed Files: htroot/PerformanceMemory_p.java, htroot/PerformanceQueues_p.java, htroot/ProxyIndexingMonitor_p.java, htroot/YBRFetch_p.java, source/net/yacy/search/Switchboard.java
Tue Jun 05 15:04:23 CEST 2012
by Michael Peter Christen
more bug fixes and performance hacks for search process
Changed Files: source/de/anomic/data/BookmarksDB.java, source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java
Mon Jun 04 23:37:41 CEST 2012
by Michael Peter Christen
more fixes for double precision of coordinates
Changed Files: source/de/anomic/data/wiki/WikiCode.java, source/net/yacy/document/geolocalization/Coordinates.java, source/net/yacy/document/parser/html/ContentScraper.java
Mon Jun 04 16:33:16 CEST 2012
by Michael Peter Christen
fix for bad distance computation
Changed Files: source/net/yacy/search/query/RWIProcess.java
Wed May 30 15:28:45 CEST 2012
by Michael Peter Christen
npe fix
Changed Files: htroot/PerformanceMemory_p.java
Tue May 29 14:46:13 CEST 2012
by Michael Peter Christen
fix for bad location evaluation
Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java, source/de/anomic/server/serverObjects.java
Tue May 29 13:08:27 CEST 2012
by Michael Peter Christen
fixes for wrong port number in shell scripts
Changed Files: bin/checkalive.sh, bin/graphicstest.sh
Tue May 29 12:43:14 CEST 2012
by Michael Peter Christen
fixes to location search
Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java
Fri May 25 16:21:44 CEST 2012
by Michael Peter Christen
fix for http://bugs.yacy.net/view.php?id=188
Changed Files: source/de/anomic/data/DidYouMean.java
Fri May 25 15:56:21 CEST 2012
by Michael Peter Christen
another patch to fix the Crawler_p layout
Changed Files: htroot/Crawler_p.html, htroot/js/Crawler.js
Sun May 20 02:59:47 CEST 2012
by Michael Peter Christen
more classification bugs
Changed Files: source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java
Sun May 20 01:35:49 CEST 2012
by Michael Peter Christen
fixed bad usage of given words
Changed Files: htroot/IndexControlRWIs_p.java
Sun May 20 01:23:02 CEST 2012
by Michael Peter Christen
search contentdom was checked in wrong way - fixed
Changed Files: source/net/yacy/search/query/RWIProcess.java
Sat May 19 23:15:29 CEST 2012
by reger
bugfix Tables_p for edit and delete selected row (correction to use "pk_"  html prefex)
Changed Files: htroot/Tables_p.java
Sat May 19 00:21:03 CEST 2012
by Michael Peter Christen
fix for http://bugs.yacy.net/view.php?id=126
Changed Files: source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/cora/protocol/http/HTTPClient.java, source/net/yacy/document/parser/html/EmbedEntry.java, source/net/yacy/document/parser/html/ImageEntry.java, source/net/yacy/kelondro/data/meta/DigestURI.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrConfiguration.java
Fri May 18 23:56:40 CEST 2012
by Michael Peter Christen
fix for http://bugs.yacy.net/view.php?id=154
Changed Files: htroot/ConfigPortal.java
Fri May 18 22:18:47 CEST 2012
by Michael Peter Christen
bugfix for http://bugs.yacy.net/view.php?id=186
Changed Files: source/net/yacy/search/Switchboard.java
Tue May 15 12:25:14 CEST 2012
by Michael Peter Christen
fixed bug in solr interface
Changed Files: source/net/yacy/search/index/MetadataRepository.java
Mon May 14 14:56:21 CEST 2012
by Michael Peter Christen
fixed bug in solr error document
Changed Files: source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/ZURL.java, source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrMultipleConnector.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/search/index/SolrConfiguration.java
Mon May 14 11:56:04 CEST 2012
by Michael Peter Christen
solrj connector bugfix
Changed Files: source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/search/Switchboard.java
Wed May 09 12:29:07 CEST 2012
by Michael Peter Christen
patch for broken configurations
Changed Files: source/net/yacy/search/Switchboard.java
Fri May 04 17:28:27 CEST 2012
by Michael Peter Christen
refactoring + parser bugfixes
Changed Files: htroot/PerformanceSearch_p.java, htroot/yacy/hello.java, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.java, htroot/yacysearchtrailer.java, source/de/anomic/crawler/RobotsTxt.java, source/de/anomic/crawler/RobotsTxtParser.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/document/parser/html/Evaluation.java, source/net/yacy/document/parser/html/TransformerWriter.java, source/net/yacy/kelondro/blob/Stack.java, source/net/yacy/kelondro/rwi/IndexCell.java, source/net/yacy/peers/Protocol.java, source/net/yacy/peers/graphics/ProfilingGraph.java, source/net/yacy/search/EventTracker.java, source/net/yacy/search/MemoryTracker.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java
Fri Apr 27 17:53:45 CEST 2012
by Michael Peter Christen
solrj user authentication patch
Changed Files: source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
Fri Apr 27 14:18:02 CEST 2012
by Michael Peter Christen
patch for media search (audio, video apps)
Changed Files: htroot/yacysearchitem.html, htroot/yacysearchitem.java, source/net/yacy/search/index/Segment.java
Fri Apr 27 14:13:59 CEST 2012
by Michael Peter Christen
fix needed for new solrj library
Changed Files: source/net/yacy/cora/services/federated/solr/SolrScheme.java
Thu Apr 26 00:04:23 CEST 2012
by Michael Peter Christen
fix for search result selection in case that contentdom is not set
Changed Files: htroot/yacysearch.java
Tue Apr 17 11:46:14 CEST 2012
by Michael Peter Christen
fixed to network graph testing
Changed Files: htroot/WebStructurePicture_p.java, source/net/yacy/visualization/GraphPlotter.java
Fri Apr 13 09:02:18 CEST 2012
by Michael Peter Christen
fix to xml output format
Changed Files: htroot/api/webstructure.java
Fri Apr 13 11:52:59 CEST 2012
by Michael Christen
fix to url citation collection 
Changed Files: source/net/yacy/search/index/Segment.java
Wed Mar 21 21:43:47 CET 2012
by Thomas
Fixes for compare-search
Changed Files: htroot/compare_yacy.java
Sat Mar 10 10:59:56 CET 2012
by Lotus
fix links & bug #163
Changed Files: htroot/Status_p.inc


Other Changes   
Jump to: YaCy Release 1.03 top / Bugfixes

CommitDescription
Tue Jun 19 08:51:26 CEST 2012
by Michael Peter Christen
Release 1.03
Changed Files: build.properties
Tue Jun 19 08:45:49 CEST 2012
by Michael Peter Christen
set Xms lower than Xmx
Changed Files: defaults/yacy.init, htroot/PerformanceQueues_p.java
Tue Jun 19 08:45:34 CEST 2012
by Michael Peter Christen
removed unimportant warnings 
Changed Files: source/de/anomic/crawler/RobotsTxt.java, source/net/yacy/document/TextParser.java, source/net/yacy/kelondro/blob/HeapReader.java, source/net/yacy/upnp/DiscoveryAdvertisement.java
Tue Jun 19 01:40:22 CEST 2012
by cominch
Only load tag information if necessary
Changed Files: htroot/interaction_elements/Tag_part.html
Tue Jun 19 01:24:06 CEST 2012
by cominch
Auto Tagging: Add hyperlinks to tags (provisional)
Changed Files: htroot/api/yacydoc.htm, htroot/api/yacydoc.java, htroot/env/templates/jqueryheader.template, htroot/interaction_elements/Tag_part.html, htroot/interaction_elements/interaction.js, htroot/jquery/js/jquery.rdfquery.core-1.0.js
Mon Jun 18 16:16:46 CEST 2012
by cominch
Merge remote-tracking branch 'original yacy/master'
Changed Files: htroot/ViewFile.java, htroot/api/yacydoc.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/protocol/RequestHeader.java
Mon Jun 18 15:55:18 CEST 2012
by Michael Peter Christen
better abstraction of document model generation
Changed Files: htroot/ViewFile.java, htroot/api/yacydoc.java, source/net/yacy/cora/lod/JenaTripleStore.java
Mon Jun 18 15:47:54 CEST 2012
by Michael Peter Christen
produce a rdf output containing the triplestore with yacydoc; ie:
http://localhost:8090/api/yacydoc.rdf?urlhash=yOiCM7Fh1hyQ
Changed Files: htroot/api/yacydoc.java, source/net/yacy/cora/protocol/RequestHeader.java
Mon Jun 18 15:44:50 CEST 2012
by cominch
Merge remote-tracking branch 'original yacy/master'
Changed Files: htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/Vocabulary_p.xml, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java
Mon Jun 18 15:44:01 CEST 2012
by cominch
Augmented browsing: Pass on additional action parameter
Changed Files: htroot/interaction_elements/Document_part.java, htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/OverlayInteraction.java, htroot/interaction_elements/Tag_part.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/interaction/AugmentHtmlStream.java
Mon Jun 18 15:19:57 CEST 2012
by Michael Peter Christen
integrate also geonames library files for less cities. these are more
useful for tagging since less normal words are false-identified as
location
Changed Files: htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java
Mon Jun 18 13:04:20 CEST 2012
by Michael Peter Christen
better apilink description
Changed Files: htroot/Vocabulary_p.html
Mon Jun 18 13:02:12 CEST 2012
by Michael Peter Christen
added ontology extraction in xml as api call for vocabularies
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/Vocabulary_p.xml
Mon Jun 18 12:11:07 CEST 2012
by cominch
Merge remote-tracking branch 'original yacy/master'
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/de/anomic/http/server/HTTPDemon.java, source/net/yacy/cora/protocol/Domains.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/importer/OAIPMHLoader.java, source/net/yacy/peers/Seed.java
Mon Jun 18 01:22:39 CEST 2012
by Michael Peter Christen
preventing that an empty pnd is inserted into the vocabularies
Changed Files: source/net/yacy/document/LibraryProvider.java
Sun Jun 17 23:05:53 CEST 2012
by cominch
Augmented Browsing: added template for document info bar
Changed Files: htroot/api/getpageinfo.java, htroot/interaction_elements/Document_part.html, htroot/interaction_elements/Document_part.java, htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/document.png, htroot/interaction_elements/interaction_metadata.js
Sun Jun 17 19:03:53 CEST 2012
by Michael Peter Christen
more logging
Changed Files: source/net/yacy/document/importer/OAIPMHLoader.java
Sun Jun 17 17:32:52 CEST 2012
by Michael Peter Christen
- added size of vocabulary to vocabulary view
- fixed bad terms in vocabulary-from-titles autogeneration
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java
Sun Jun 17 14:53:16 CEST 2012
by Michael Peter Christen
added more methods to vocabulary generation: scrape document title and
document author to vocabulary
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/interaction/Triple.java, source/net/yacy/cora/lod/JenaTripleStore.java
Sun Jun 17 10:50:12 CEST 2012
by Michael Peter Christen
- automatic periodic saving of triplestore
- transaction-safe storage of triplestore
Changed Files: source/de/anomic/server/serverSwitch.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/search/Switchboard.java, source/net/yacy/yacy.java
Sun Jun 17 10:15:26 CEST 2012
by Michael Peter Christen
- accept only location names wit a minimum length
- remove comma from synonym terms
Changed Files: htroot/DictionaryLoader_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java, source/net/yacy/document/geolocation/OverarchingLocation.java
Sun Jun 17 01:12:31 CEST 2012
by Michael Peter Christen
- use only names which consists of at least two parts
- remove word from derewo from locations
Changed Files: htroot/DictionaryLoader_p.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocation/GeonamesLocation.java, source/net/yacy/document/geolocation/OpenGeoDBLocation.java
Sun Jun 17 00:33:40 CEST 2012
by Michael Peter Christen
removed old navigation practice using subject tags in favor of
triplestore-tags
Changed Files: htroot/yacysearch.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/Document.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/kelondro/data/meta/URIMetadataRow.java, source/net/yacy/search/query/RWIProcess.java
Sat Jun 16 22:30:31 CEST 2012
by Michael Peter Christen
more robust OAI-PMH client (large time-out, three re-tries). OAI-PMH
server appeart to be very slow sometimes
Changed Files: defaults/yacy.init, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/net/yacy/document/importer/OAIPMHLoader.java
Sat Jun 16 19:40:27 CEST 2012
by Michael Peter Christen
added recognition of multi-word terms in vocabulary matching
this makes the PND usable: it is now possible to recognize persons and
navigate with a 'Persons' facet.
Changed Files: source/net/yacy/document/Autotagging.java, source/net/yacy/document/Condenser.java
Sat Jun 16 17:40:15 CEST 2012
by Michael Peter Christen
show triplestore metadata in yacydoc and viewfile
Changed Files: htroot/ViewFile.html, htroot/ViewFile.java, htroot/api/yacydoc.html, htroot/api/yacydoc.java, htroot/api/yacydoc.xml, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/document/Autotagging.java, source/net/yacy/search/query/RWIProcess.java
Sat Jun 16 15:57:00 CEST 2012
by Michael Peter Christen
ipv6 update
Changed Files: source/net/yacy/cora/protocol/Domains.java
Sat Jun 16 12:36:15 CEST 2012
by Michael Peter Christen
added the generation of virtual vocabularies using the pnd
Changed Files: htroot/Vocabulary_p.java, htroot/interaction/Triple.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/document/LibraryProvider.java
Fri Jun 15 19:19:18 CEST 2012
by Michael Peter Christen
- added loading of the dbpedia pnd triplestore in the dictionary loader
- renamed the dictionary loader to knowledge loader
- some refactoring in the library provider method names
Changed Files: htroot/DictionaryLoader_p.html, htroot/DictionaryLoader_p.java, htroot/env/templates/submenuSemantic.template, source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/OverarchingLocation.java
Fri Jun 15 19:13:07 CEST 2012
by Michael Peter Christen
made triplestore persistent by default
added a size display in triplestore servlet
Changed Files: defaults/yacy.init, htroot/Triplestore_p.html, htroot/Triplestore_p.java
Fri Jun 15 14:32:16 CEST 2012
by cominch
Augmented browsing: Add overlay bar which shows the vocabulary tags
Changed Files: htroot/interaction_elements/OverlayInteraction.html, htroot/interaction_elements/OverlayInteraction.java, source/net/yacy/interaction/AugmentHtmlStream.java
Fri Jun 15 11:54:33 CEST 2012
by Michael Peter Christen
renamed "augmented proxy" to "augmented browsing"
Changed Files: htroot/ConfigPortal.html, htroot/yacysearchitem.html
Fri Jun 15 10:46:19 CEST 2012
by cominch
add missing files for tag display
Changed Files: htroot/env/templates/interactionheader.template, htroot/interaction_elements/Tag_part.html, htroot/interaction_elements/Tag_part.java, htroot/interaction_elements/tag.png
Fri Jun 15 10:44:12 CEST 2012
by cominch
Merge remote-tracking branch 'original yacy/master'
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java
Fri Jun 15 10:43:05 CEST 2012
by cominch
Show tags in search results (if activated in ConfigPortal_p.html)
Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/interaction/Triple.java, htroot/interaction_elements/interaction.js, htroot/yacysearch.html, htroot/yacysearchitem.html, htroot/yacysearchitem.java, source/net/yacy/cora/lod/JenaTripleStore.java
Fri Jun 15 02:43:55 CEST 2012
by Michael Peter Christen
create new vocabularies also without an objectspace. this creates an
empty vocabulary
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java
Thu Jun 14 19:55:34 CEST 2012
by Michael Peter Christen
- fixed Cache link (below snippet)
- added 'Augmented Proxy' link below snippet
- added configuration options for augmented proxy
Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/Vocabulary_p.java, htroot/yacysearchitem.html, htroot/yacysearchitem.java
Thu Jun 14 19:11:19 CEST 2012
by Michael Peter Christen
added api icon to triplestore
Changed Files: htroot/Triplestore_p.html
Thu Jun 14 18:50:35 CEST 2012
by Michael Peter Christen
added objectlink generation to vocabulary generation and editor
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Document.java
Thu Jun 14 18:14:45 CEST 2012
by Michael Peter Christen
check also delete triplestore by default
Changed Files: htroot/IndexControlRWIs_p.html
Thu Jun 14 17:41:45 CEST 2012
by cominch
Cleanup of interaction class and helper routines
Changed Files: htroot/interaction/Table.java, htroot/interaction/Table.json, htroot/interaction/Triple.java, htroot/interaction/Triple.json, source/net/yacy/interaction/Interaction.java
Thu Jun 14 15:44:27 CEST 2012
by cominch
Triplestore: modify routines to access per user store
Changed Files: htroot/interaction/Triple.java, source/net/yacy/cora/lod/JenaTripleStore.java
Thu Jun 14 11:46:53 CEST 2012
by cominch
Triplestore: initalize per-user triplestores
Changed Files: source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/search/Switchboard.java, source/net/yacy/yacy.java
Thu Jun 14 09:45:57 CEST 2012
by Michael Peter Christen
refactoring (Localization -> Location)
Changed Files: htroot/DictionaryLoader_p.java, source/net/yacy/document/LibraryProvider.java, source/net/yacy/document/geolocalization/GeonamesLocation.java, source/net/yacy/document/geolocalization/OpenGeoDBLocation.java, source/net/yacy/document/geolocalization/OverarchingLocation.java
Wed Jun 13 15:53:18 CEST 2012
by Michael Peter Christen
- added automated generation of vocabularies from url stubs
- added clear of all terms for vocabularies
- added deletion of vocabularies
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java, source/net/yacy/search/index/Segment.java
Wed Jun 13 13:05:41 CEST 2012
by Michael Peter Christen
The 'Locale' vocabulary, which is generated by geo data, has now the
objectspace "http://dbpedia.org/resource/"
Changed Files: htroot/Vocabulary_p.html, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/document/Autotagging.java
Wed Jun 13 12:12:20 CEST 2012
by Michael Peter Christen
added a vocabulary editor
Changed Files: htroot/Vocabulary_p.html, htroot/Vocabulary_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuSemantic.template, source/net/yacy/cora/lod/vocabulary/Tagging.java
Mon Jun 11 02:37:52 CEST 2012
by reger
adjusted classpath for   lib/arq-2.8.7.jar lib/htmllexer.jar lib/htmlparser.jar lib/iri-0.8.jar lib/jena-2.6.4.jar lib/sax-2.0.1.jar
Changed Files: nbproject/project.xml
Tue Jun 12 02:12:01 CEST 2012
by Michael Peter Christen
moved new servlets into one submenu "Content Semantic"
Changed Files: htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsing_p.html, htroot/AugmentedParsing_p.html, htroot/DictionaryLoader_p.html, htroot/Triple_p.html, htroot/Triplestore_p.html, htroot/env/templates/header.template, htroot/env/templates/submenuConfig.template, htroot/env/templates/submenuSemantic.template
Tue Jun 12 01:54:36 CEST 2012
by Michael Peter Christen
added option to clean the triplestore when deleting the index
Changed Files: htroot/IndexControlRWIs_p.html, htroot/IndexControlRWIs_p.java, source/net/yacy/cora/lod/JenaTripleStore.java
Tue Jun 12 01:42:58 CEST 2012
by Michael Peter Christen
allow multiple parser options instead of printing an error
Changed Files: source/net/yacy/document/TextParser.java, source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/document/parser/htmlParser.java, source/net/yacy/document/parser/rdfa/impl/RDFaParser.java
Tue Jun 12 00:20:11 CEST 2012
by Michael Peter Christen
proper namespaces in triplestore dump
Changed Files: source/net/yacy/cora/lod/JenaTripleStore.java, source/net/yacy/cora/lod/vocabulary/Geo.java, source/net/yacy/cora/lod/vocabulary/HttpHeader.java, source/net/yacy/cora/lod/vocabulary/Tagging.java, source/net/yacy/cora/lod/vocabulary/YaCyMetadata.java
Mon Jun 11 09:22:45 CEST 2012
by cominch
augmented browsing: remove non-existing external snippet file
Changed Files: source/net/yacy/interaction/AugmentHtmlStream.java
Mon Jun 11 08:07:53 CEST 2012
by cominch
preparation and generalization of augmented browsing methods
Changed Files: htroot/interaction_elements/interaction.js, htroot/interaction_elements/interaction_metadata.js, source/net/yacy/interaction/AugmentHtmlStream.java
Mon Jun 11 09:22:45 CEST 2012
by cominch
augmented browsing: remove non-existing external snippet file
Changed Files: source/net/yacy/interaction/AugmentHtmlStream.java
Mon Jun 11 08:07:53 CEST 2012
by cominch
preparation and generalization of augmented browsing methods
Changed Files: htroot/interaction_elements/interaction.js, htroot/interaction_elements/interaction_metadata.js, source/net/yacy/interaction/AugmentHtmlStream.java
Mon Jun 11 02:37:52 CEST 2012
by reger
adjusted classpath for   lib/arq-2.8.7.jar lib/htmllexer.jar lib/htmlparser.jar lib/iri-0.8.jar lib/jena-2.6.4.jar lib/sax-2.0.1.jar
Changed Files: nbproject/project.xml
Mon Jun 11 01:20:54 CEST 2012
by Michael Peter Christen
close the reader if finished
Changed Files: source/net/yacy/kelondro/blob/HeapReader.java
Mon Jun 11 00:38:02 CEST 2012
by Michael Peter Christen
added missing blacklist dht cache storage (maybe due to mistakes in
cherry picking)
Changed Files: source/net/yacy/repository/Blacklist.java, source/net/yacy/search/Switchboard.java
Wed May 30 16:57:54 CEST 2012
by Roland 'Quix0r' Haeder
Fix to make all values lower-case (this should make all existing blacklists compatible with the new enum)
Changed Files: source/net/yacy/repository/Blacklist.java
Sun Jun 10 23:40:07 CEST 2012
by Roland 'Quix0r' Haeder
One is okay ...

Conflicts:
	htroot/Trails.html
Changed Files: htroot/Trails.html
Sun Jun 10 23:38:41 CEST 2012
by Roland 'Quix0r' Haeder
Scroogle is not comming back, remove dead code

Conflicts:
	source/net/yacy/search/Switchboard.java
Changed Files: defaults/yacy.init, htroot/ConfigHeuristics_p.html, htroot/ConfigHeuristics_p.java, htroot/ConfigNetwork_p.java, source/net/yacy/search/Switchboard.java
Sun Jun 10 23:17:21 CEST 2012
by Michael Peter Christen
removed usage of deprecated methods
Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/interaction/TripleStore.java
Sun Jun 10 21:54:30 CEST 2012
by Michael Peter Christen
do not load the "_triplestore.rdf" files which are of special use in
sciencenet
Changed Files: source/net/yacy/yacy.java
Sun Jun 10 21:49:02 CEST 2012
by Michael Peter Christen
load all - but not the persistent local.rdf - triples from
DATA/TRIPLESTORE at startup time. The local.rdf is loaded only if the
persistent switch is on (as before).
Changed Files: htroot/Triple_p.java, source/net/yacy/interaction/TripleStore.java, source/net/yacy/yacy.java
Sun Jun 10 13:17:23 CEST 2012
by Michael Peter Christen
removed autocrawler and feedback servlet link since that was not
cherry-picked
Changed Files: htroot/env/templates/header.template
Sun Jun 10 13:11:54 CEST 2012
by cominch
bugfix

Conflicts:
	source/net/yacy/document/parser/augment/AugmentParser.java
Changed Files: source/net/yacy/document/Document.java, source/net/yacy/search/query/RWIProcess.java
Sun Jun 10 13:10:21 CEST 2012
by cominch
augmentation

Conflicts:
	source/net/yacy/interaction/AugmentHtmlStream.java
Changed Files: htroot/interaction/Sidepanel_part.html, source/net/yacy/interaction/AugmentHtmlStream.java
Wed May 30 17:11:31 CEST 2012
by cominch
interaction javascript
Changed Files: htroot/api/getpageinfo.java, htroot/api/getpageinfo.json, htroot/api/getpageinfo.xml, htroot/interaction/interaction_metadata.js
Sun Jun 10 13:07:57 CEST 2012
by cominch
augmented browsing modification

Conflicts:
	htroot/interaction/OverlayInteraction.html
	source/net/yacy/interaction/AugmentHtmlStream.java
Changed Files: htroot/interaction/OverlayInteraction.html, htroot/interaction/OverlayReview.html, htroot/interaction/OverlayReview.java, htroot/interaction/formdata.js, htroot/interaction/interaction_sciety.js, source/net/yacy/interaction/AugmentHtmlStream.java
Wed May 16 15:05:17 CEST 2012
by cominch
re-enable augmented proxy
Changed Files: source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/interaction/AugmentHtmlStream.java
Sun Jun 10 13:03:56 CEST 2012
by cominch
bugfix

Conflicts:
	source/net/yacy/interaction/AugmentHtmlStream.java
Changed Files: source/net/yacy/interaction/AugmentHtmlStream.java
Wed May 16 09:23:44 CEST 2012
by cominch
small change
Changed Files: htroot/interaction/Suggest.html
Wed May 16 09:22:55 CEST 2012
by cominch
RDF demo servlet
Changed Files: htroot/DemoServletRDF.html, htroot/DemoServletRDF.java, htroot/interaction/PutRDF.java, htroot/interaction/PutRDF.json, htroot/js/rdf/jquery.rdfquery.core-1.0.js
Sun Jun 10 13:02:00 CEST 2012
by cominch
small changes

Conflicts:
	source/net/yacy/document/parser/augment/AugmentParser.java
	source/net/yacy/interaction/Interaction.java
Changed Files: source/net/yacy/document/parser/augment/AugmentParser.java, source/net/yacy/interaction/Interaction.java
Mon Mar 12 11:45:27 CET 2012
by cominch
prepare RDF dump routines
Changed Files: htroot/interaction/GetRDF.java, htroot/interaction/GetRDF.json, htroot/interaction/GetRDF.xml
Sun Jun 10 12:58:29 CEST 2012
by cominch
Updated Demo Servlet

Conflicts:
	htroot/About.html
	htroot/DemoServlet.html
	htroot/DemoServlet.java
	htroot/interaction/interaction.js
	source/net/yacy/interaction/Interaction.java
Changed Files: htroot/DemoServlet.html, htroot/DemoServlet.java, htroot/interaction/UploadSingleFile.html, htroot/interaction/UploadSingleFile.java, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java, source/net/yacy/interaction/TripleStore.java, source/net/yacy/yacy.java
Sun Jun 10 12:49:36 CEST 2012
by cominch
Added config switches for custom parser

Conflicts:
	source/net/yacy/document/TextParser.java
Changed Files: defaults/yacy.init, htroot/AugmentedParsing_p.html, htroot/AugmentedParsing_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuAugmentedParsing.template, source/net/yacy/document/TextParser.java
Fri Feb 24 17:02:57 CET 2012
by cominch
Catch malformed URL when submitted in encoded style
Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java
Fri Feb 24 16:09:44 CET 2012
by cominch
Add a global value store
Changed Files: htroot/interaction/Table.java, htroot/interaction/interaction.js
Sun Jun 10 12:43:01 CEST 2012
by cominch
interaction: add special table interaction

Conflicts:
	source/net/yacy/interaction/Interaction.java
Changed Files: source/net/yacy/interaction/Interaction.java
Sun Jun 10 12:41:16 CEST 2012
by cominch
interaction: add special table interaction

Conflicts:
	source/net/yacy/interaction/Interaction.java
Changed Files: htroot/DemoServletInteraction.html, htroot/interaction/OverlayInteraction.html, htroot/interaction/Table.java, htroot/interaction/Table.json, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java
Sun Jun 10 12:39:27 CEST 2012
by cominch
interaction: add global variable store

Conflicts:
	source/net/yacy/interaction/Interaction.java
Changed Files: source/net/yacy/interaction/Interaction.java
Sun Jun 10 12:34:36 CEST 2012
by cominch
interaction: add global variable store

Conflicts:
	source/net/yacy/interaction/Interaction.java
Changed Files: htroot/DemoServletInteraction.html, htroot/interaction/Triple.java, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java
Sun Jun 10 12:31:49 CEST 2012
by cominch
create virtual web folder /currentyacypeer/ which always points to local
peer, even when using the urlproxy

Conflicts:
	source/de/anomic/http/server/HTTPDProxyHandler.java
Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/http/server/HTTPDProxyHandler.java
Sun Jun 10 12:28:50 CEST 2012
by cominch
Add tagging overlay element

Conflicts:
	htroot/env/templates/jqueryheader.template
	htroot/yacysearchitem.java
	source/net/yacy/interaction/Interaction.java
Changed Files: htroot/DemoServletInteraction.html, htroot/env/templates/jqueryheader.template, htroot/interaction/OverlayInteraction.html, htroot/interaction/Triple.java, htroot/yacysearchitem.java, source/net/yacy/interaction/Interaction.java
Sun Jun 10 10:56:39 CEST 2012
by cominch
Small fix

Conflicts:
	htroot/yacysearchitem.java
Changed Files: htroot/yacysearchitem.java
Sun Jun 10 10:55:00 CEST 2012
by cominch
Add Triplestore settings functionality

Conflicts:
	htroot/env/templates/header.template
Changed Files: htroot/Triple_p.csv, htroot/Triple_p.html, htroot/Triplestore_p.html, htroot/Triplestore_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuTriplestore.template
Sun Jun 10 10:53:30 CEST 2012
by cominch
Add new demonstration module for client-side key-value store (backend:
triplestore): /DemoServletInteraction.html

Conflicts:
	source/net/yacy/interaction/Interaction.java
Changed Files: htroot/DemoServletInteraction.html, htroot/DemoServletInteraction.java, htroot/interaction/Triple.java, htroot/interaction/Triple.json, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java
Sun Jun 10 10:51:53 CEST 2012
by cominch
Demonstration: include value from interaction in search results

Conflicts:
	htroot/interaction/OverlayInteraction.html
	htroot/yacysearchitem.java
Changed Files: htroot/Triple_p.html, htroot/Triple_p.java, htroot/interaction/OverlayInteraction.html, htroot/yacysearchitem.html, htroot/yacysearchitem.java, source/net/yacy/interaction/Interaction.java
Tue Feb 14 15:51:20 CET 2012
by cominch
Small changes
Changed Files: htroot/interaction/Triple.java, source/de/anomic/http/server/HTTPDFileHandler.java
Sun Jun 10 10:38:54 CEST 2012
by cominch
add interaction for triples and selector for augmented browsing

Conflicts:
	htroot/interaction/interaction.js
	source/net/yacy/interaction/Interaction.java
Changed Files: htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsingFilters_p.java, htroot/interaction/OverlayInteraction.html, htroot/interaction/Triple.java, htroot/interaction/Triple.json, htroot/interaction/interaction.js, source/net/yacy/interaction/Interaction.java
Mon Feb 13 18:04:22 CET 2012
by cominch
Allow TripleStore to be persistent after reboot
Changed Files: source/net/yacy/interaction/TripleStore.java, source/net/yacy/yacy.java
Sun Jun 10 10:29:15 CEST 2012
by cominch
augmented browsing: ignore js and css, integrate more user interaction

Conflicts:
	htroot/interaction/Footer.html
	source/net/yacy/interaction/AugmentHtmlStream.java
Changed Files: htroot/interaction/Footer.html, htroot/interaction/OverlayInteraction.html, htroot/interaction/OverlayInteraction.java, source/net/yacy/interaction/AugmentHtmlStream.java
Sun Jun 10 10:23:35 CEST 2012
by cominch
augmentedParser add features and integrate external html parser to
modify existing web pages

Conflicts:
	addon/YaCy.app/Contents/Info.plist
	build.xml
Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, lib/htmllexer.jar, lib/htmlparser.jar, source/de/anomic/http/server/ServerSideIncludes.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/yacy.java
Sun Jun 10 10:15:34 CEST 2012
by cominch
augmentedProxy, which forwards every proxy request to a
rewrite engine to customize existing webpages. originally implemented by
Florian Richter.

Conflicts:
	source/de/anomic/http/server/HTTPDProxyHandler.java
Changed Files: htroot/robots.java, source/de/anomic/http/server/AugmentedHtmlStream.java, source/de/anomic/http/server/HTTPDProxyHandler.java, source/net/yacy/document/parser/images/genericImageParser.java, source/net/yacy/interaction/AugmentHtmlStream.java, source/net/yacy/kelondro/blob/ArrayStack.java
Thu Jan 19 14:24:17 CET 2012
by cominch
Add menu entries for urlproxy / augmented browsing
Changed Files: htroot/AugmentedBrowsingFilters_p.html, htroot/AugmentedBrowsingFilters_p.java, htroot/AugmentedBrowsing_p.html, htroot/AugmentedBrowsing_p.java, htroot/env/templates/header.template, htroot/env/templates/submenuAugmentation.template
Wed Jan 18 10:14:33 CET 2012
by cominch
add json mimetype
Changed Files: defaults/httpd.mime
Sat Jun 09 11:00:33 CEST 2012
by Michael Peter Christen
using utf8 String compression in Webstructure database
Changed Files: source/net/yacy/kelondro/util/FileUtils.java, source/net/yacy/peers/graphics/WebStructureGraph.java
Sat Jun 09 10:07:11 CEST 2012
by Michael Peter Christen
saved a bit more ram using UTF8 String compression for OpenGeoDB and
Geonames data files.
Changed Files: source/net/yacy/document/geolocalization/GeoLocation.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java, source/net/yacy/search/Switchboard.java
Sat Jun 09 09:46:27 CEST 2012
by Michael Peter Christen
made the GeoLocation into an interface with the current
integer implementation as accuracy implementation of 1.863cm
Changed Files: source/net/yacy/document/geolocalization/GeoLocation.java, source/net/yacy/document/geolocalization/GeoPoint.java, source/net/yacy/document/geolocalization/IntegerGeoPoint.java
Sat Jun 09 09:10:54 CEST 2012
by Michael Peter Christen
added location search to main menu
Changed Files: htroot/env/templates/header.template
Sat Jun 09 09:05:47 CEST 2012
by Michael Peter Christen
- changed initialization order to prefer allocation of memory for table
files first
- bugfixes in memory amount calculation
Changed Files: source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/Switchboard.java
Fri Jun 08 18:36:11 CEST 2012
by Michael Peter Christen
only the metadata tables shall be able to use the tail cache
Changed Files: source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/Switchboard.java
Fri Jun 08 12:48:25 CEST 2012
by Michael Peter Christen
- less restrictions for usage of Table RAM copy
- new limit to use the table copy (instead of flag): 400MB available. If
less is available, then a copy is never used. If more is available, then
it can be used if there is a remaining space of at least 200MB
- flush caches more often: flush the Digest cache
Changed Files: defaults/yacy.init, source/net/yacy/kelondro/order/Digest.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/MetadataRepository.java
Fri Jun 08 09:48:46 CEST 2012
by Michael Peter Christen
bugfix: do not switch off standard memory strategy when performing a
forced GC
PLEASE CHECK if your peer has standard memory switched on!
Changed Files: htroot/PerformanceMemory_p.java
Fri Jun 08 09:41:29 CEST 2012
by Michael Peter Christen
lazy initialization of block rank table ... only normal web search uses
this. When interactive search or location search is used, the block rank
is switched off
Changed Files: htroot/index.java, htroot/yacyinteractive.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/search/ranking/BlockRank.java
Fri Jun 08 09:30:51 CEST 2012
by Michael Peter Christen
lazy initialization of database tables
Changed Files: source/net/yacy/kelondro/blob/Tables.java
Fri Jun 08 09:14:54 CEST 2012
by Michael Peter Christen
fixed RWIProcess queue limits: now discovering hidden results for mass
result retrieval
Changed Files: htroot/IndexControlRWIs_p.java, source/net/yacy/cora/services/federated/SearchResult.java, source/net/yacy/cora/sorting/WeakPriorityBlockingQueue.java, source/net/yacy/search/index/DocumentIndex.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SearchEvent.java, source/net/yacy/search/query/SnippetProcess.java
Fri Jun 08 09:13:41 CEST 2012
by Michael Peter Christen
fixed handlemap spread factor and null iterator handling
Changed Files: htroot/PerformanceMemory_p.java, source/net/yacy/kelondro/blob/MapHeap.java, source/net/yacy/kelondro/index/HandleMap.java, source/net/yacy/kelondro/index/RAMIndexCluster.java, source/net/yacy/kelondro/order/StackIterator.java, source/net/yacy/kelondro/util/StandardMemoryStrategy.java
Thu Jun 07 19:42:33 CEST 2012
by Michael Peter Christen
flush the compressor cache when a cleanup is done
Changed Files: source/de/anomic/crawler/Cache.java, source/net/yacy/kelondro/blob/Compressor.java, source/net/yacy/search/Switchboard.java
Thu Jun 07 13:16:38 CEST 2012
by Michael Peter Christen
lazy initialization of block rank table.
this causes that the table is not initialized when there is no search is
done. the effect is most strong if YaCy is started headless which causes
no browser pop-up which otherwise would load the search page and
therefore trigger the initialization of the table.
Changed Files: htroot/yacyinteractive.java, htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/search/ranking/BlockRank.java
Thu Jun 07 12:36:26 CEST 2012
by Michael Peter Christen
enhanced hint for debian package automatic update
Changed Files: htroot/ConfigUpdate_p.html
Wed Jun 06 14:27:18 CEST 2012
by Michael Peter Christen
accept also file names beginning with "file://" for crawl start from
file.
Changed Files: htroot/CrawlStartExpert_p.html, htroot/Crawler_p.java
Wed Jun 06 14:17:42 CEST 2012
by Michael Peter Christen
use less cache space since a large cache would cause more memory usage
in index files.
Changed Files: defaults/yacy.init
Wed Jun 06 14:15:24 CEST 2012
by Michael Peter Christen
added automatic cleaning of cache if metadata and file database size is
not equal. It might happen that these data is different because one of
that caches is cleaned after a while or when it is too big. The metadata
is then not cleaned, but now wiped after a checkup process at every
application start. This should cause a bit less memory usage.
Changed Files: htroot/ConfigHTCache_p.java, source/de/anomic/crawler/Cache.java, source/net/yacy/kelondro/blob/Compressor.java, source/net/yacy/kelondro/blob/MapHeap.java
Wed Jun 06 13:36:10 CEST 2012
by Michael Peter Christen
accept also files with other file prefix; used to read 'foreign' cache
files
Changed Files: source/net/yacy/kelondro/blob/ArrayStack.java
Wed Jun 06 12:57:42 CEST 2012
by Michael Peter Christen
added GeoLocation / GeoPoint classes which uses less memory than
Location/Coordinates and has initializers with correct order of lat,lon
coordinates
Changed Files: htroot/yacysearch.java, htroot/yacysearch_location.java, source/net/yacy/document/geolocalization/GeoLocation.java, source/net/yacy/document/geolocalization/GeoPoint.java, source/net/yacy/document/geolocalization/GeonamesLocalization.java, source/net/yacy/document/geolocalization/Localization.java, source/net/yacy/document/geolocalization/OpenGeoDBLocalization.java, source/net/yacy/document/geolocalization/OverarchingLocalization.java
Tue Jun 05 18:29:54 CEST 2012
by Michael Peter Christen
allow more POIs, get more at once
Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java, source/net/yacy/cora/services/federated/opensearch/SRURSSConnector.java
Mon Jun 04 23:44:26 CEST 2012
by Michael Peter Christen
added show from cache in search results (not yet finished)
Changed Files: defaults/yacy.init, htroot/ConfigPortal.html, htroot/ConfigPortal.java, htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.html, htroot/yacysearchitem.java, htroot/yacysearchtrailer.java, source/net/yacy/cora/storage/Files.java
Mon Jun 04 23:43:30 CEST 2012
by Michael Peter Christen
adopted vocabulary usage within anotation/naviagtion feature of search
to new SimpleVocabulary class
Changed Files: source/net/yacy/search/query/QueryParams.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/query/SnippetProcess.java
Mon Jun 04 23:41:36 CEST 2012
by Michael Peter Christen
moved Vocabulary to cora package (added in git
964406ad17a461322ab3478e9e832c302a9e9dc5)
Changed Files: source/net/yacy/document/Autotagging.java
Mon Jun 04 23:35:56 CEST 2012
by Michael Peter Christen
added concurrency enhancement to xml parser
Changed Files: source/net/yacy/cora/document/RSSReader.java, source/net/yacy/cora/lod/SimpleVocabulary.java, source/net/yacy/document/content/SurrogateReader.java, source/net/yacy/document/importer/OAIListFriendsLoader.java, source/net/yacy/document/importer/ResumptionToken.java, source/net/yacy/document/parser/mmParser.java, source/net/yacy/document/parser/odtParser.java, source/net/yacy/document/parser/ooxmlParser.java, source/net/yacy/document/parser/xml/opensearchdescriptionReader.java
Mon Jun 04 15:34:53 CEST 2012
by Michael Peter Christen
using pre-compile pattern in blacklist; should enhance search speed
Changed Files: source/net/yacy/repository/Blacklist.java
Fri Jun 01 00:08:31 CEST 2012
by Michael Peter Christen
- bugfix for surrogate file reader
- bugfix for location search: suppress empty search
Changed Files: htroot/yacysearch_location.java, source/net/yacy/document/content/DCEntry.java
Thu May 31 14:05:36 CEST 2012
by Michael Peter Christen
- added double-buffering for search layers
- added automatic zooming to search result
to location search
Changed Files: htroot/yacysearch_location.html
Thu May 31 01:12:06 CEST 2012
by Michael Peter Christen
automatically zoom to result layer bounds
Changed Files: htroot/yacysearch_location.html
Thu May 31 00:47:52 CEST 2012
by Michael Peter Christen
- show number of results in map search interface
- transfer view radius within query
Changed Files: htroot/yacysearch_location.html, htroot/yacysearch_location.java
Thu May 31 00:47:07 CEST 2012
by Michael Peter Christen
store more data from interface access
Changed Files: source/net/yacy/search/query/AccessTracker.java
Thu May 31 00:46:30 CEST 2012
by Michael Peter Christen
performance hacks
Changed Files: source/net/yacy/kelondro/index/Row.java
Wed May 30 17:14:25 CEST 2012
by Michael Peter Christen
better location to generate a guid for rss messages
Changed Files: source/net/yacy/cora/document/RSSMessage.java
Wed May 30 16:44:03 CEST 2012
by Michael Peter Christen
RSSMessages do not need a concurrent hash map -> removed overhead
Changed Files: source/net/yacy/cora/document/RSSMessage.java
Wed May 30 16:40:37 CEST 2012
by Michael Peter Christen
enhanced RSS parsing by ensuring that it is parsed with a buffered input
stream
Changed Files: source/net/yacy/cora/document/MultiProtocolURI.java, source/net/yacy/cora/document/RSSReader.java
Wed May 30 16:26:05 CEST 2012
by Michael Peter Christen
introduced a default 10 second time-out in rwi normalization time
uring search process to prevent endless deadlocks after a very long
running search
Changed Files: source/net/yacy/kelondro/data/word/WordReferenceVars.java, source/net/yacy/peers/Protocol.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/RWIProcess.java, source/net/yacy/search/ranking/ReferenceOrder.java
Wed May 30 15:47:35 CEST 2012
by Michael Peter Christen
better logging
Changed Files: source/net/yacy/kelondro/logging/Log.java
Wed May 30 15:42:28 CEST 2012
by Michael Peter Christen
only ASCII needed in seed bitflags
Changed Files: source/net/yacy/peers/Seed.java
Wed May 30 15:28:20 CEST 2012
by Michael Peter Christen
using double instead float for a better release ordering
Changed Files: source/net/yacy/peers/operation/yacyRelease.java, source/net/yacy/peers/operation/yacyVersion.java
Wed May 30 15:27:45 CEST 2012
by Michael Peter Christen
better logging
Changed Files: source/de/anomic/http/server/HTTPDFileHandler.java, source/de/anomic/server/serverCore.java, source/net/yacy/kelondro/logging/Log.java, source/net/yacy/kelondro/order/MergeIterator.java, source/net/yacy/kelondro/workflow/InstantBlockingThread.java, source/net/yacy/kelondro/workflow/InstantBusyThread.java
Wed May 30 10:03:50 CEST 2012
by PCA42
Windows Installer: update to Oracle Java 7u4
Changed Files: build.nsi
Wed May 30 09:32:25 CEST 2012
by Michael Peter Christen
added node state to xml
Changed Files: htroot/Network.xml
Tue May 29 12:00:32 CEST 2012
by Michael Peter Christen
added all shell scripts in /bin to add also latest passwd.sh file
Changed Files: build.xml
Tue May 29 02:22:02 CEST 2012
by Michael Peter Christen
removed osmarender from yacysearch_location because that caused a
javascript error
Changed Files: htroot/yacysearch_location.html
Tue May 29 01:38:54 CEST 2012
by Michael Peter Christen
- fixes to node identification
- added link to node in network list
- added marking of portal search node peers
Changed Files: htroot/Network.html, htroot/Network.java, htroot/RemoteCrawl_p.java, htroot/yacy/hello.java, source/net/yacy/peers/Seed.java, source/net/yacy/peers/SeedDB.java, source/net/yacy/peers/dht/PeerSelection.java, source/net/yacy/peers/operation/yacyVersion.java
Tue May 29 00:06:33 CEST 2012
by Michael Peter Christen
enhanced RootState icon
Changed Files: htroot/env/grafics/RootStateNo.gif, htroot/env/grafics/RootStateYes.gif
Fri May 25 17:29:54 CEST 2012
by Michael Peter Christen
added node state icon in network list
Changed Files: htroot/Network.html, htroot/Network.java, htroot/env/grafics/RootStateNo.gif, htroot/env/grafics/RootStateYes.gif, source/net/yacy/peers/Seed.java
Fri May 25 15:33:02 CEST 2012
by Michael Peter Christen
added a root node flag: identifies peers with short ping time
Changed Files: source/net/yacy/peers/Protocol.java, source/net/yacy/peers/Seed.java
Fri May 25 01:45:38 CEST 2012
by Michael Peter Christen
redesign of the crawler monitor page: show crawled pages instead of
queue of urls that shall be crawled
Changed Files: htroot/Crawler_p.html, htroot/env/templates/submenuCrawlMonitor.template, htroot/js/Crawler.js, source/net/yacy/cora/document/RSSMessage.java, source/net/yacy/search/Switchboard.java
Wed May 23 18:00:37 CEST 2012
by Michael Peter Christen
Added more steering in Crawler_p.html interface
Changed Files: htroot/CrawlProfileEditor_p.java, htroot/Crawler_p.html, htroot/Crawler_p.java, source/de/anomic/crawler/CrawlProfile.java
Wed May 23 15:45:07 CEST 2012
by Michael Peter Christen
hack against 100% cpu during crawl delete
Changed Files: source/de/anomic/crawler/Balancer.java
Mon May 21 02:27:06 CEST 2012
by Michael Peter Christen
removed stack trace from swf parser since we cant do anything there
Changed Files: source/net/yacy/document/parser/swfParser.java
Mon May 21 01:58:29 CEST 2012
by Michael Peter Christen
- fixed image search page navigation
- removed some deadlocks and ConcurrentModificationExceptions during
DidYouMean collection
Changed Files: htroot/yacy/search.java, htroot/yacysearch.java, htroot/yacysearchitem.java, htroot/yacysearchlatestinfo.java, source/net/yacy/search/query/QueryParams.java
Mon May 21 00:59:41 CEST 2012
by Michael Peter Christen
added more interruptions in DidYouMean because that was the cause for
some blockings during search
Changed Files: source/de/anomic/data/DidYouMean.java
Mon May 21 00:58:29 CEST 2012
by Michael Peter Christen
synchronization needed
Changed Files: source/net/yacy/kelondro/index/RAMIndex.java
Mon May 21 00:19:03 CEST 2012
by Michael Peter Christen
changed queue sizes to have less memory occupied during indexing
Changed Files: source/net/yacy/search/Switchboard.java
Mon May 21 00:18:00 CEST 2012
by Michael Peter Christen
bugfix for http://bugs.yacy.net/view.php?id=173
Changed Files: source/net/yacy/search/snippet/TextSnippet.java
Sun May 20 05:25:16 CEST 2012
by reger
bugfix: lookup of peernames no result for active peer in page IndexControlRWIs_p.html -> Transfer RWI to other Peer
SeedDB.lookupByName searche for lowercase peerNames, while MapColumnIndex.getIndex uses peername as is in the keyset.
Changed the index init to insert lowercase peer names as key
Changed Files: htroot/IndexControlRWIs_p.html, htroot/IndexControlRWIs_p.java, source/net/yacy/kelondro/blob/MapColumnIndex.java
Sun May 20 00:50:54 CEST 2012
by Michael Peter Christen
relax verify attribute for search widget to make it faster:
set to "cacheonly"
Changed Files: defaults/yacy.init, htroot/ConfigLiveSearch.html, htroot/ConfigSearchBox.html, htroot/Load_PHPBB3.html, htroot/env/templates/portalinput.template, htroot/portalsearch/yacy-portalsearch.html
Sat May 19 02:09:16 CEST 2012
by reger
correct typo in scripts_txt comment
Changed Files: source/net/yacy/search/index/SolrField.java
Fri May 18 22:33:41 CEST 2012
by Michael Peter Christen
moved files to defaults
Changed Files: build.xml
Fri May 18 22:33:16 CEST 2012
by Michael Peter Christen
the last commit was incomplete..
Changed Files: source/net/yacy/cora/protocol/Domains.java, source/net/yacy/search/Switchboard.java
Thu May 17 11:08:48 CEST 2012
by Michael Peter Christen
small speed enhancement using a column factory
Changed Files: source/net/yacy/kelondro/index/Column.java, source/net/yacy/kelondro/index/RowCollection.java
Thu May 17 06:03:18 CEST 2012
by Roland 'Quix0r' Haeder
More sync in close() methods

Conflicts:
	source/net/yacy/kelondro/logging/GuiHandler.java
	source/net/yacy/kelondro/workflow/InstantBusyThread.java
Changed Files: source/net/yacy/kelondro/logging/GuiHandler.java, source/net/yacy/kelondro/workflow/InstantBusyThread.java, source/net/yacy/search/index/DocumentMetadata.java, source/net/yacy/search/index/DocumentReference.java
Thu May 17 06:00:49 CEST 2012
by Roland 'Quix0r' Haeder
With or without 'final'? At least please try it in other methods

Conflicts:
	source/de/anomic/tools/tarTools.java
Changed Files: source/de/anomic/tools/tarTools.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/search/index/DocumentMetadata.java
Tue May 15 20:57:38 CEST 2012
by Roland 'Quix0r' Haeder
Made a method static (Eclipse suggested it), removed unused import, pk=null check does now output a warning in logfile
Changed Files: htroot/Banner.java, source/net/yacy/kelondro/table/Table.java, source/net/yacy/search/index/SolrConfiguration.java
Thu May 17 05:49:25 CEST 2012
by Roland 'Quix0r' Haeder
No & in JavaScript-embeded URLs, added ability to stop focus in
ConfigPortal.html preview (is this not secured with _p????)

Conflicts:
	htroot/yacyinteractive.java
	htroot/yacysearch.java
Changed Files: htroot/index.html, htroot/yacyinteractive.java, htroot/yacysearch.html, htroot/yacysearch.java
Thu May 17 05:18:52 CEST 2012
by Michael Peter Christen
prevent that the snippet fectch process removes catchall entries
Changed Files: source/net/yacy/search/index/Segment.java, source/net/yacy/search/query/SnippetProcess.java
Thu May 17 04:26:03 CEST 2012
by Michael Peter Christen
moved yacy.logging to defaults according to request in
http://bugs.yacy.net/view.php?id=55
Changed Files: defaults/yacy.logging, source/net/yacy/yacy.java
Thu May 17 03:55:10 CEST 2012
by Michael Peter Christen
Pattern.quote() replaces \\Q and \\E according to publication in
http://www.cs.washington.edu/homes/mernst/pubs/regex-types-ftfjp2012.pdf
Changed Files: htroot/Load_RSS_p.java, source/de/anomic/data/ymark/YMarkCrawlStart.java, source/de/anomic/data/ymark/YMarkTables.java
Wed May 16 10:14:44 CEST 2012
by Michael Peter Christen
typo
Changed Files: htroot/IndexFederated_p.html
Wed May 16 01:04:08 CEST 2012
by Michael Peter Christen
ups
Changed Files: defaults/yacy.init
Tue May 15 23:10:47 CEST 2012
by Michael Peter Christen
added serialization
Changed Files: htroot/IndexFederated_p.html, source/net/yacy/cora/storage/ConfigurationSet.java, source/net/yacy/search/index/SolrConfiguration.java
Tue May 15 12:25:46 CEST 2012
by Michael Peter Christen
added configuration to switch off redirection following in crawler
Changed Files: defaults/yacy.init, source/de/anomic/crawler/retrieval/HTTPLoader.java, source/net/yacy/search/SwitchboardConstants.java
Tue May 15 12:24:54 CEST 2012
by Michael Peter Christen
enhanced crawler/balancer: better remaining waiting-time guessing
Changed Files: source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/Latency.java
Sat May 12 10:39:01 CEST 2012
by Michael Peter Christen
made multiple connector default
Changed Files: htroot/IndexFederated_p.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/search/Switchboard.java
Sat May 12 10:32:42 CEST 2012
by Michael Peter Christen
- enhanced the solr connector
- added new multiple connector (to replace singleConnector)
Changed Files: source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrMultipleConnector.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
Fri May 11 20:46:50 CEST 2012
by Michael Peter Christen
more tolerance in case of corrupted file
Changed Files: source/net/yacy/kelondro/table/Table.java
Fri May 11 11:33:05 CEST 2012
by Michael Peter Christen
moved debian dependency to openjdk-7
Changed Files: debian/control
Fri May 11 00:40:56 CEST 2012
by reger
Adjust NetBeans config to use lib/solr-3.6.jar
Changed Files: nbproject/project.xml
Wed May 09 23:43:12 CEST 2012
by Michael Peter Christen
added missing classes for solr interface
Changed Files: source/net/yacy/cora/services/federated/solr/SolrDoc.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java
Wed May 09 17:21:19 CEST 2012
by Michael Peter Christen
better abstraction for solr objects
Changed Files: source/net/yacy/cora/services/federated/solr/SolrConnector.java, source/net/yacy/cora/services/federated/solr/SolrField.java, source/net/yacy/cora/services/federated/solr/SolrRetryConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingConnector.java, source/net/yacy/cora/services/federated/solr/SolrShardingSelection.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java, source/net/yacy/search/index/SolrConfiguration.java
Wed May 09 17:00:56 CEST 2012
by Michael Peter Christen
more abstraction in solr connection classes
Changed Files: htroot/IndexFederated_p.java, source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/SolrConfiguration.java
Wed May 09 12:28:43 CEST 2012
by Michael Peter Christen
enhancement in circle drawing
Changed Files: source/net/yacy/visualization/CircleTool.java
Tue May 08 23:24:39 CEST 2012
by Michael Peter Christen
less 'wellformed' calls without asserts
Changed Files: source/net/yacy/kelondro/index/Row.java
Tue May 08 20:07:34 CEST 2012
by Marc Nause
*) better formatting for network QPM
*) refactoring
Changed Files: htroot/Banner.java, source/net/yacy/peers/graphics/Banner.java, source/net/yacy/peers/graphics/BannerData.java, source/net/yacy/peers/graphics/NetworkGraph.java
Mon May 07 00:54:00 CEST 2012
by Michael Peter Christen
removed superfluous column
Changed Files: htroot/IndexCreateQueues_p.html, htroot/IndexCreateQueues_p.java
Mon Apr 30 11:09:54 CEST 2012
by Michael Peter Christen
removed superfluous files
Changed Files: addon/yacy-svn-4.spec, build.xml
Sun Apr 29 21:22:23 CEST 2012
by Michael Peter Christen
Merge remote branch 'bbyacy-rc1/master'
Changed Files: htroot/yacysearch.html, htroot/yacysearch.java, htroot/yacysearch.rss
Sun Apr 29 21:21:49 CEST 2012
by Michael Peter Christen
Merge commit 'c1f6b4fb5226d3d2f8b2bec9e361f6b3476e03ff'
Changed Files: source/net/yacy/peers/SeedDB.java
Sun Apr 29 05:50:56 CEST 2012
by reger
changed link to opensearchdescription document to a absolute uri (in yacysearch.html and yacysearch.rss)
see http://www.opensearch.org/Specifications/OpenSearch/1.1/Draft_5#The_.22Description.22_element
Changed Files: htroot/yacysearch.html, htroot/yacysearch.java, htroot/yacysearch.rss
Fri Apr 27 18:26:36 CEST 2012
by Michael Peter Christen
removed methods not supported by new solrj connector for httpclient 4
Error was:
java.lang.UnsupportedOperationException: Client was created outside of
HttpSolrServer
	at
org.apache.solr.client.solrj.impl.HttpSolrServer.setDefaultMaxConnectionsPerHost(HttpSolrServer.java:614)
	at
net.yacy.cora.services.federated.solr.SolrSingleConnector.<init>(SolrSingleConnector.java:128)
	at
net.yacy.cora.services.federated.solr.SolrShardingConnector.<init>(SolrShardingConnector.java:55)
	at net.yacy.search.Switchboard.<init>(Switchboard.java:657)
	at net.yacy.yacy.startup(yacy.java:222)
	at net.yacy.yacy.main(yacy.java:1018)
	
Changed Files: source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
Fri Apr 27 17:48:51 CEST 2012
by Michael Peter Christen
added new entry class for embed tags
Changed Files: source/net/yacy/document/parser/html/EmbedEntry.java
Fri Apr 27 17:46:08 CEST 2012
by Michael Peter Christen
- fixed build problems (deprecated methods using httpclient 3.1)
- removed httpclient 3.1 lib which was used by solrj (solrj now uses
httpclient 4)
Changed Files: .classpath, addon/YaCy.app/Contents/Info.plist, build.xml, source/net/yacy/cora/protocol/http/HTTPClient.java, source/net/yacy/cora/services/federated/solr/SolrHTTPClient.java, source/net/yacy/cora/services/federated/solr/SolrSingleConnector.java
Fri Apr 27 17:20:18 CEST 2012
by Michael Peter Christen
concurrency enhancement in ConfigurationSet
Changed Files: source/net/yacy/cora/storage/ConfigurationSet.java
Fri Apr 27 16:48:51 CEST 2012
by Michael Peter Christen
- solved problems with backpath normalization
- redesigned in/outbound link handover
- removed iframe links from inbound/outbound in solr scheme
Changed Files: htroot/api/webstructure.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java, source/net/yacy/document/Document.java, source/net/yacy/document/parser/html/ContentScraper.java, source/net/yacy/search/index/Segment.java
Fri Apr 27 11:22:34 CEST 2012
by Michael Peter Christen
updated solrj lib
Changed Files: .classpath, lib/apache-solr-solrj-3.6.0.License, lib/apache-solr-solrj-3.6.0.jar
Thu Apr 26 15:25:07 CEST 2012
by Michael Peter Christen
- enhanced solr field documentation
- added xml api button to IndexFederated_p - the solr schema.xml file
can be generated by YaCy
Changed Files: htroot/IndexFederated_p.html, htroot/IndexFederated_p.java, htroot/Network.html, htroot/api/schema_p.java, source/net/yacy/cora/services/federated/solr/SolrScheme.java
Thu Apr 26 00:27:21 CEST 2012
by Michael Peter Christen
hack to get all results if the actual number is between 10 and 64
Changed Files: htroot/js/yacyinteractive.js
Thu Apr 26 00:23:18 CEST 2012
by Michael Peter Christen
- apply directDocByURL to NOLOAD Queue
- choose pushing to NOLOAD as default for site crawl
Changed Files: htroot/CrawlStartSite_p.html, htroot/Crawler_p.java, source/net/yacy/search/Switchboard.java
Tue Apr 24 16:04:13 CEST 2012
by Michael Peter Christen
increased image preview size
Changed Files: htroot/env/base.css, htroot/yacysearchitem.html
Tue Apr 24 12:55:58 CEST 2012
by Michael Peter Christen
changed search process for images: no more media snippet load process,
show only links from index which had been on the text search page
before. This creates a superfast search process for images!
Changed Files: htroot/ViewFile.java, htroot/yacysearchitem.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/TextSnippet.java
Tue Apr 24 12:54:41 CEST 2012
by Michael Peter Christen
refactoring
Changed Files: source/de/anomic/crawler/Cache.java, source/de/anomic/http/server/HTTPDProxyHandler.java
Tue Apr 24 12:05:37 CEST 2012
by Michael Peter Christen
one more scroogle...
Changed Files: htroot/yacysearch.java
Tue Apr 24 12:04:44 CEST 2012
by Michael Peter Christen
removed scroogle parser
Changed Files: htroot/yacysearch.java
Tue Apr 24 00:05:01 CEST 2012
by reger
lookupByIP:  prevent comparing of port parameter if called with port -1 (=unknown)
Changed Files: source/net/yacy/peers/SeedDB.java
Sat Apr 21 21:32:31 CEST 2012
by Michael Peter Christen
removed dependency from logging
Changed Files: source/net/yacy/cora/document/Classification.java
Sat Apr 21 21:31:13 CEST 2012
by Michael Peter Christen
refactoring: moved document Classification to cora package
Changed Files: source/de/anomic/crawler/retrieval/FileLoader.java, source/de/anomic/crawler/retrieval/Request.java, source/de/anomic/crawler/retrieval/Response.java, source/de/anomic/crawler/retrieval/SMBLoader.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/cora/document/Classification.java, source/net/yacy/document/Document.java, source/net/yacy/document/TextParser.java, source/net/yacy/search/snippet/MediaSnippet.java
Sat Apr 21 13:47:48 CEST 2012
by Michael Peter Christen
refactoring: removed dependency from switchboard in Balancer/CrawlQueues
Changed Files: htroot/IndexCreateQueues_p.java, htroot/yacy/urls.java, source/de/anomic/crawler/Balancer.java, source/de/anomic/crawler/CrawlQueues.java, source/de/anomic/crawler/Latency.java, source/de/anomic/crawler/NoticedURL.java
Thu Apr 19 13:29:08 CEST 2012
by Michael Peter Christen
no more SVN
Changed Files: htroot/RemoteCrawl_p.html
Thu Apr 19 13:28:12 CEST 2012
by Michael Peter Christen
no more SVN..
Changed Files: htroot/Network.html
Thu Apr 19 12:35:11 CEST 2012
by Michael Peter Christen
one more warning in case that crawling is paused because of low disk
space
Changed Files: htroot/Status.html, htroot/Status.java
Thu Apr 19 11:50:24 CEST 2012
by Michael Peter Christen
'download'
Changed Files: htroot/env/templates/submenuConfig.template
Thu Apr 19 11:49:43 CEST 2012
by Michael Peter Christen
update location update
Changed Files: defaults/yacy.network.allip.unit, defaults/yacy.network.freeworld.unit, defaults/yacy.network.intranet.unit, defaults/yacy.network.metager.unit, defaults/yacy.network.webportal.unit
Thu Apr 19 11:11:14 CEST 2012
by Michael Peter Christen
add hint to speed up search results
Changed Files: htroot/ConfigPortal.html, htroot/env/base.css
Thu Apr 19 11:10:48 CEST 2012
by Michael Peter Christen
add hint for consulting support
Changed Files: htroot/Status.html, htroot/Status.java
Wed Apr 18 10:30:04 CEST 2012
by Michael Peter Christen
fix for parser problem if a <a>-tag is 'within' html tags with unclosed
tags. That prevented the <a> tags from beeing recognized. This is a fix
for http://forum.yacy-websuche.de/viewtopic.php?p=25516#p25516
Changed Files: source/net/yacy/document/parser/html/TransformerWriter.java
Tue Apr 17 12:30:14 CEST 2012
by Michael Peter Christen
display is not used any more
Changed Files: htroot/ViewFile.html
Tue Apr 17 11:22:19 CEST 2012
by Michael Peter Christen
automatic generation of blacklist pattern, see
http://forum.yacy-websuche.de/viewtopic.php?f=5&t=2685&p=25305#p25305
Changed Files: htroot/Blacklist_p.java
Mon Apr 16 23:43:50 CEST 2012
by Michael Peter Christen
added citation rank to ranking profile
Changed Files: htroot/Ranking_p.java, source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/ranking/RankingProfile.java
Mon Apr 16 09:50:55 CEST 2012
by Michael Peter Christen
check if httpc has decompressed the release file and rename the file
from .tar.gz to .tar if that happened
Changed Files: source/de/anomic/tools/tarTools.java, source/net/yacy/document/parser/tarParser.java, source/net/yacy/peers/operation/yacyRelease.java
Mon Apr 16 04:00:04 CEST 2012
by reger
remove heuristic scroogle from search option help text in index.html
Changed Files: htroot/index.html
Fri Apr 13 11:53:34 CEST 2012
by Michael Christen
extended webstructure api to show together with incoming links also
outgoing links
Changed Files: htroot/api/webstructure.java, htroot/api/webstructure.xml
Fri Apr 13 06:47:33 CEST 2012
by Michael Christen
experimental implementation of a citation ranking as post-ranking
method. (ranking coefficient fixed, need to be made configurable)
Changed Files: source/net/yacy/search/query/SnippetProcess.java, source/net/yacy/search/snippet/ResultEntry.java
Sat Mar 31 07:38:49 CEST 2012
by Michael Christen
added information about inbound, outbound and citation links into
yacydoc api servlet
Changed Files: htroot/api/yacydoc.html, htroot/api/yacydoc.java, htroot/api/yacydoc.xml
Thu Mar 29 17:22:31 CEST 2012
by Michael Christen
added an api to retrieve the new citation.index with the
webstructure.xml api. This api will respond with details about a single
URL if requested with 'webstructure.xml?about=[url|urlhash|host]'.
Changed Files: htroot/api/webstructure.java, htroot/api/webstructure.xml
Thu Mar 29 17:20:14 CEST 2012
by Michael Christen
added storage of full anchor link structure:
the links between all pages are now stored. The same index structure as
used for the word index is used to make a reverse link index.
The new file(s) in SEGMENT/default/citation.index.*.blob store the
citation index. This will be used to create much more detailed link
structures for the YaCy apis and to create a better ranking. A ranking
using the citation.index should provide better results especially for
portal indexes and initranets.
Changed Files: source/net/yacy/search/Switchboard.java, source/net/yacy/search/index/Segment.java, source/net/yacy/search/index/Segments.java
Wed Mar 28 21:50:00 CEST 2012
by Michael Christen
fixed default must-match filter for full domain crawls - the old filter
was to restrictive and did not allow intranet crawls
Changed Files: source/de/anomic/crawler/CrawlProfile.java, source/de/anomic/crawler/CrawlStacker.java
Sun Mar 25 22:21:42 CEST 2012
by Lotus
some better feedback on properties change
Changed Files: htroot/ConfigProperties_p.html, htroot/ConfigProperties_p.java
Fri Mar 23 17:02:50 CET 2012
by Lotus
added hint how to change integration options
Changed Files: htroot/ConfigPortal.html
Tue Mar 20 23:00:06 CET 2012
by Thomas
Remove Scroogle from compare-search, Scroogle is dead 
Changed Files: htroot/compare_yacy.java
Sat Mar 17 21:10:29 CET 2012
by Lotus
no focus on preview frames for search integration
fixes bug http://bugs.yacy.net/view.php?id=161
Changed Files: htroot/ConfigPortal.html, htroot/WatchWebStructure_p.html, htroot/index.html, htroot/index.java, htroot/yacyinteractive.html, htroot/yacyinteractive.java, htroot/yacysearch.html, htroot/yacysearch.java
Sat Mar 17 20:43:19 CET 2012
by Lotus
allow custom ppm lower than minimum button on /Crawler_p.html
fixes http://bugs.yacy.net/view.php?id=166
Changed Files: source/net/yacy/search/Switchboard.java
Mon Mar 12 09:30:44 CET 2012
by Lotus
checkalive.sh: try to fetch only once (default: 20)
Changed Files: bin/checkalive.sh
Tue Feb 28 13:18:46 CET 2012
by Michael Peter Christen
added physics experiment to the graph plotter. not active by default
Changed Files: htroot/WebStructurePicture_p.java, source/net/yacy/visualization/GraphPlotter.java
Mon Feb 27 21:27:17 CET 2012
by Michael Peter Christen
better names for elements of a linked graph
Changed Files: htroot/WebStructurePicture_p.java, source/net/yacy/visualization/GraphPlotter.java
Mon Feb 27 00:52:44 CET 2012
by Michael Peter Christen
bugfix for a must-not-match pattern check. This bug did not make the
check semantically wrong, but a trick that prevented an IP lookup in
case that the filter was not used did not work. That bugfix causes that
crawling gets a huge speed boost for noload urls!
Changed Files: source/de/anomic/crawler/CrawlStacker.java
Sun Feb 26 20:53:32 CET 2012
by Michael Peter Christen
if a new pop-up page is set in config portal, then this page applies
also to the default page configuration for the httpd if no path is
given.
Changed Files: htroot/ConfigBasic.java, htroot/ConfigPortal.java, source/de/anomic/http/server/HTTPDFileHandler.java, source/net/yacy/search/SwitchboardConstants.java
Sun Feb 26 17:32:45 CET 2012
by Michael Peter Christen
better navigation in file search: less results by first try, but much
faster. after the first search is done, buttons appear to get more
results for the same search
Changed Files: htroot/js/yacyinteractive.js, htroot/yacyinteractive.java
Sun Feb 26 00:06:57 CET 2012
by reger
adjust Netbeans project class path settings to updated httpclient and commons jars
Changed Files: nbproject/project.xml
Sun Feb 26 00:04:25 CET 2012
by reger
fix: prevent logging of Solr doc content

with attached Solr server transfered content is written to log despite
log level = off
fixed naming of httpclient logger
Changed Files: yacy.logging