IoixUkraine

Multifunctional multi-user search system based on engine (the IOIX Ukraine proprietary design) for web resources indexation and parametrizable and non-parametrizable artificial intelligence search with advanced linguistic subsystem, including morphological analysis of Japanese, English, Russian and German languages. The Search engine also features a flexible system of search results ranging with custom sorting criteria setup option, multiple relevancy parameters support and smart relevancy algorithm, intelligent subsystem of found content parts highlight, custom templates of search results and design. Primary purpose: Intended for global and local network resources indexation and search by assigned web-sites with a wide set of qualifying criteria. The search can be performed by all indexed resources in the system, by all resources of the user’s registered sites, and by one user’s registered site. In addition to the search options, users are also offered statistic information in form of set of reports about various performed searches parameters. Basic functions (specification):
- Search by indexed resources
- Web resources indexation
- Search activity analysis
User is allowed to be registered and to add sites for indexation within the created account; place the search section on his own web-resources with ability to install and set up specific interface, design and search space restriction by preset page addresses and other criteria. The system contains a variety of reports controlling the search section on remote resources, which enable the complete evaluation of the site’s production and pages popularity. The software product has a user interface and API.

Technologies: С/C++, PHP, MySql, HTTP, NFS, Linux Sockets epoll, threads pools, xpdflib, iconv, curl

Implemented solutions:
- Search query server is a high-performance multithreading server application with pipeline architecture of parallel query processing. It supports GET HTTP 1.0, 1.1 method. Performs search query processing, content organization according to user’s design template. Related words search server is a high-end multithreading server application, which intends to find word pairs with high frequency of occurrence in the indexed content and high degree of logical connection; returns the list of possible query choices using alternative words.
- Indexation server (crawler) is a high-performance multithreading server application performing the network resources scanning, content parsing and web resources data indexation. Supported formats are HTML based, XML, RSS, PDF, plain text.
- Dictionaries server and linguistic subsystem is a high-end single-threaded application performing morphological analysis and query words normalization, alternative query generation offering modifications of probably misspelled words. Supports multiple languages (up to 32 languages simultaneously. Currently implemented are English, German, French, Russian, Ukrainian, Japanese as basic dictionaries and Russian, English and Japanese – with morphology support).
- Distributed storage system for indexed resources and data. The system also includes additional server applications, such as resources data repository, indexation management, reference repository, search engines, clustering and cataloging server, extended recourses content browse server.

Multi-speed scanning system of web-resources. Suitable for word-processing formats, HTML, XML (RSS) and PDF. Implemented in C / C + +.

Intellectual system, analyzing and normalizing text in Russian, Ukrainian, Japanese, English, German and French language and prepares base for the indexing of web-pages, mapping the site, the creation of dictionaries and thesauruses. Implemented in C / C + +.

Mechanism of scanning web-page to determine the structure of an Internet resource and creating a coherent map of the existing site on the scanned pages. Created map is generated in XML and is designed for use by search engines (currently the search engine “Google”) to facilitate, accelerate and optimize the indexing of pages of web-resource for which you created this map.

The mechanism of comments and notices on external resources (blocks of news, forums, etc.)

It is a system that modifies the contents of the block output page in a remote site, depending on several parameters: the type of user, time, date, day of week, number of visits to the user, territorial identity, user ID, etc.

The system is designed to control access to web-servers on the Internet, analyzing the parameters of access, quality of information, error logging and problem situations.

Includes:
- Maintaining database Sellers
- Maintenance of advertisers (sites that host advertising links)
- Maintaining a database of goods
- The possibility of placing advertising Links to third-party sites
- Maintenance of statistics on page views, referrals, record sales of a special link, the account number, cost and payment of the sale of goods
- Creation and billing for the services of advertisers etc.

The system of distribution, storage and synchronization of information between data stores and servers. When large amounts of information increases the speed of the site dozens of times.

The system includes:

For the user site:
- User registration,
- Sending out notices with the password,
- The function of sending forgotten passwords,
- Local ISQ
For the site administrator:
- The ability to change and add the admin menu,
- Ready interface for control and organization of content,
- You can change the administrator content (interface and text information) of the site,
- Full control over access to the site,
- Full control over the data Members area,
- System messages (news site),
- System messages (ISQ),
- Distribution system messages (on email),
- Automatic control of visits registered and not registered users of IP-addresses,
- Automatically send reminders authorization,
- Automatic removal is not activated by users,
- Enable / disable is not required functionality.