the order of interaction official website for the ...

Download PDF
2 downloads 106900 Views 385KB Size Report
Comment
... parameter «signature» electronic signature belongs to the organization that must ..... CMS Advanced Electronic Signatures (CadES) / CAdES. Basic Electronic ...
THE ORDER OF INTERACTION OFFICIAL WEBSITE FOR THE PROVISION OF PROCUREMENT INFORMATION AND WEBSITES OF PUBLIC CONTROL OF PROCUREMENT (ON THE EXAMPLE OF THE RUSSIAN CONTRACT SYSTEM) N.A. Mamedova Moscow State University of Economics, Statistics and Informatics (MESI), Moscow, Ph.D., Associate professor MESI, [email protected] (first author) A.N. Baykova Moscow State University of Economics, Statistics and Informatics (MESI), Moscow, Research Assistant MESI, [email protected]

Abstract ─ The paper presents a detailed procedure for institutional and technical cooperation official site for posting information about procurement organizations and sites of social control for the purposes of monitoring, analysis and evaluation of the placement of procurement. The object of study is a Russian contract system, the subject of the study are procedures for the transfer, handling, placing, dissemination and use of information on procurement. The result of this study is the organizational chart storage, conversion and data organization site formalization of social control, which ensures the implementation of searches by website users upload data from the official website for posting information about procurement. Keywords ─ Automated systems, information exchange, information on procurement.

In Russia, the main source of information on the procurement of state and municipal customers is the official website of the Russian Federation in the "Internet" for posting information about placing orders for goods, works and services for federal needs, the needs of subjects of the Russian Federation or municipal needs (hereinafter – AC OOC). AC OOC consolidates information on all purchases based on the technology disclosure of the full procurement cycle – from planning of procurement to entering information on the completion of execution of the contract. The open part of the AC OOC is used for searching for information, analysis and monitoring of data on the activities of customers, regulatory authorities, and public discussion of the procurement. However, AC OOC is not designed to handle user requests for aggregated data selection, for example, a summary of the procurement on a particular region or a summary of the procurement individual customer. The site "Public procurement control: analysis and statistics" is a service of information and analytical support for the monitoring and analysis of purchases intended for subjects of public control of their powers. The structure and content of information blocks combined site by topic, information is accumulated from an official source, processed and provided to users who are interested in obtaining analytical and statistical data on procurement. Resources site make it possible to not only the perception of information, but also an active user interaction with the resource by processing search queries according to the capacity of the site. Organizational chart of accumulation, conversion and data formalization site consists of two components. The first

component of the scheme, the procedures sending, receiving and publishing documents on the AC OOC (Fig. 1). The second component of the scheme to upload documents with the AU DUS information translated into the local database of the site and processing a user request to the site (Fig. 2). Let us examine both of these components to have a detailed understanding of the process of operation of the site and its capabilities. AC OOC integration with related systems is provided by the transmission of electronic documents of a certain format, converted using the markup language XML (hereinafter - XMLdocuments) transmitted in electronic form via telecommunication channels. The list of related systems involved in the process of receiving and transmitting the information is private. Under adjacent systems, understand hardware and software systems (HSS) of the following subjects:  HSS electronic trading platforms (EP);  HSS external systems placing the order (ESPL);  HSS Russian Federal Antimonopoly Service (FAS);  HSS Federal Treasury of Russia (FTR). Certain formats of XML-documents are for information transfer during all methods of placing procurement, registration of contracts (including information on their performance and termination), registering complaints, recording the results of the control activities (including information on the implementation of decisions and orders of regulatory bodies). AC OOC receives data from related systems via HTTPS, uploads data to ftp-server and communicates with external parties (EP; ESPL; FAS) data protocol Applicability Statement 2 (hereinafter - AS2) [1]. List of electronic platforms and external systems placing the order with which data is exchanged in the form AS2, strictly defined. The following parameters data exchange via AS2 are established:  format XML;  protected telecommunication channels using hardwaresoftware complex encryption "Continent" 3.5 (which is certified by the FSC and FSTEC Russia);  compliance with XML-schema document integration fcsIntegration.xsd;  the amount of transferred XML-documents from 1 to 100 MB (for the flow of information «AC OOC ↔ HSS EP);  the number of connected external automated systems is not changed (not made new connections) (for the flow of information «AC OOC ↔ ESPL HSS). Procedures for receiving and transmitting information using the HTTPS protocol are presented in the following list:  formation of information;  publication of documents;  uploading data to ftp-server AC OOC;



provision of published documents and background information. Formation of information is done by referrals from external systems place an order for the AC OOC XMLdocuments (for example, procurement notices or information about the contract) in UTF-8. XML-document signed by the electronic digital signature (hereinafter - EDS), formed by a certificate authority. This ensures that the XML-document contains information coordinated properly. By electronic signature requirements are as follows: the formation in accordance with standard CadES-BES [2]; Format Base64 (detached). Web form for loading XML-documents available at http://zakupki.gov.ru/pgz/extegration.jsp. Means for transmitting information from neighboring systems on AC OOC defined with the following parameters:  information is transmitted via secure telecommunication channels at (https://zakupki.gov.ru/pgz/services/upload) open part of the AC OOC over HTTPS. It uses a cryptographic protocol TLS (client authentication is not required);  permitted to transfer XML-document of no more than 100 megabytes;  a time limit for HTTPS-session for slow connections 120 seconds;  as investments into XML-documents are accepted file formats pdf, docx, doc, rtf, xls, xlsx, jpeg, jpg, bmp, tif, tiff, txt, zip, rar, gif, csv, odp, odf, ods, odt, sxc, sxw. Information on AC OOC sent using the method POST (Content-Type: multipart / form-data), using the following parameters:  login (type - string, required) - name of the user performing the load information (user login to access the «My Account» AC OOC);  password (type - string, required) - user password to enter the «My Account» AC OOC;  clientType (type - string, optional) - the type of customer, the possible values of EP ESPL (default ESPL);  signature (type - file, optional) - electronic signature XML-document. After receiving POST-request application software AC OOC monitors the information obtained by the following algorithm: 1. Checking authentication information:  control of authentication information that is passed in POST-request login and password, the definition of users to download the notice or information about the contract for OOC;  control of access rights on the formation of the transmitted XML-type document. 2. Checking XML-document:  control of compliance with the format specified by these requirements;  control of the logical integrity and consistency of information transmitted;  control exercised by the automated control subsystem of posted information;  control on the format, the size of the attached files, as well as anti-virus control. 3. Verify digital signatures (carried out in if the digital signature XML-document transmitted as part POSTrequest):  control certificate for compliance with these requirements: the certificate must not be expired or revoked, shall be issued to the powers of the authorized

body in accordance with the document "Terms of Use single universal certificate";  distortion control information in XML-document. If the results of monitoring in the transmitted information contains no critical violations, application software AC OOC will download the information in «My Account», an organization that appears in the XML-document as an organization, to place orders. The downloaded information becomes available to users AC OOC «My Account» in a mode that excludes changes in the user interface, under the authority of the organization, privileges and access rights of users and speaker setup AC OOC. If the XML-document that was sent as part of POSTrequest requires approval to another entity (such as the authorized body), examines what passed in the parameter «signature» electronic signature belongs to the organization that must implement the agreement. If this is the case, the document shall be deemed approved and displayed in «My Account» organization that appears in the XML-document as an organization, to place orders. Otherwise, auto-negotiation does not occur, and the document is displayed in «My Account» organization that appears in the XML-document how to reconcile the organization. Based on the results generated synchronous control protocol download data in XML format. Formed protocol is transmitted in response to a POST-request in the form of XMLmessages. Boot protocol may include:  information about the download data in «My Account»;  a list of detected errors and irregularities (reflected in the record list of detected errors and violations);  status "in processing" and the number of downloads. Query Protocol for AC OOC is performed using the method of GET. In response will be given the boot protocol, which in the case of a successful download the document, the protocol identifier will be loaded document and the hyperlink to display the form of the loaded document. At this stage in the formation of information in AC OOC ends and begins the stage of publication of documents. After the implementation of the protocol request, download user organization engaged in placement of information must be signed in to «My Account» EP and start the procedure of publication with the following features:  in case of incorrect information loaded in the «My account», you must correct the information by reloading XML-document (indicating the identifier (ID-protocol boot information) in the formation of XML-document to reload);  the need for coordination is determined by the speaker setup AC OOC. Published XML-documents are uploaded to ftp-server AC OOC. These are discharged in the form of XML-files generated in accordance with the scheme fcsExport.xsd and packed in ZIP-archives. Each archive contains in its name indication of the type of discharge and length of time for which the archive contains data. Unloading subject to the following data types:  full discharge of all outstanding regional / published on AC OOC documents;  uploading data for bank guarantees;  unloading background information;  uploading data on contracts for the AS TSAFK. Archives landings documents may include a set of files, each of which there is only one XML-document. In this case, one file can contain different types of documents are XMLdocuments and contain no more than 1,000 XML-documents. Each file in the archive contains a filename views contained

therein XML-document (actually XML-tag facility in accordance with the scheme fcsExport.xsd) and register number of the object described by XML-page document or register number of the object, change unloaded XML-document. In addition, the file name is usually indicated in the document identifier AC OOC. All unloading can be performed automatically (default) mode, and can be run manually by the operator. Unloading of published documents, launched by the operator, characterized in Related systems HSS EP HSS ESPL HSS FAS HSS FTR

protocol AS2

protocol HTTPS

that the name of the archive is added to specify a discharge date and time of discharge. For information about published in the open part of the AC OOC documents, the user can take advantage of the public discharge of all the published data on the AC OOC. Organizational chart of all the processes of reception and transmission of information (creation of data, publication data, data upload) to AC OOC is presented in Figure 1.

Procedures for receiving and transmitting information Transfer of XML - documents:  POST method (ContentType:mult:part/form-data)  web-form (http//zakupki.gov.ru/pgz/extegration.js p)  authentication (protocol TLS)  digital signature (standard CadES-BES; Base64 (detached))

metodPOST

reload XML document reload XML document

Automated system nationwide official website (AC OOC)

POSTinquiry

  

Access to information in the Personal Area organization that places an order

Control information check authentication information check XML – document check digital signature

Download XML - documents in the Personal Area organization that places an order POST - request

Protocol request download XML - documents

The transmission of information list of detected errors (violations) The transmission of information about the download

GET method

incorrect information Publication of XML - documents in the Personal Area  ID - the boot protocol information indicating the ID boot protocol information

Formation of a synchronous protocol download (format XML)  status "in processing" and the number of downloads

 

correctness of the information

Issuance boot protocol ID of the loaded document hyperlink to display the form of the loaded document

automatic unloading upload XML - files

Uploading XML - files to ftp server (ftp://free:[email protected])  scheme (fcsExport.xsd)  format (ZIP - archive)

Operator mode

Open access users AC OOC information with ftp - server

Fig. 1 Diagram of processes of reception and transmission of information between the AU and related environmental protection systems

All generated and archived XML-files are uploaded to ftp-server ftp://free:[email protected]. Since landing XML-files to ftp-server, they become available for download any information systems, with any frequency and in any amount. This can be a one-off transaction and a constant load on the update sites ftp-server. In Russia there is a market consulting services to organizations involved in procurement. The portfolio of services typically involves the selection of procurement placed in accordance with the profile of the participant procurement, analysis, documentation, accounting and legal support for the preparation of the participant action, filing (offers) prior to the conclusion of the contract. All organizations providing similar services carry out sample procurement documents for the purchase of forming their own databases planned, ongoing, completed purchases using resources ftp-server AC OOC. The site "Public procurement control: analysis and statistics" also download updates ftp-server with the help of a robot in accordance with the following regulations:



each calendar day (daily) loaded list of documents published in the previous calendar day;  each calendar month (monthly) cleans directories prevMonth, move files from the directory currMonth to the directory prevMonth and cleaning directory currMonth;  each calendar month (monthly) loaded list of documents published in the previous calendar month;  daily and monthly downloads are always loaded all types of documents published for the last calendar day or calendar month, respectively. If at the time of formation of load during this period there have been no published document of any type, the XML-file with this type of document is loaded empty;  after completion of monthly downloads, catalogs with daily downloads for the past month are cleared. Thus, AC OOC provides everything needed to load XML data through the protocol FTP. The data are grouped by date and are updated daily. Formed on each date format file ZIP-

file, which includes data on all procurement contracts published on the relevant date. Each publication corresponds to one XMLdocument archive. Unfortunately, the XML format is not designed for easy browsing. This is the format of information exchange between applications, so it cannot be used to query the user site social control. To solve the problem to achieve an efficient operation of the site database is formed, through which the data is searched according to a user request. As a database server (DBMS) is defined MySQL. This system is an open, common and reliable and fast enough to perform the functions assigned to it. It implements the relational data model, which allows a quick search and analytical processing of the data. Filling the database consists of two stages:  primary content using all available XML-documents to ftp-server;  daily updates posted XML-documents to ftp-server in accordance with the regulations. To populate the database application developed special robot in an interpreted language general-purpose Python 3.4. Base the choice of language is a classification for that language interpreter to open source software that can be used without licensing restrictions. The robot runs on a schedule (cronjob) on the server that hosts the database, connects to the AC OOC, and downloads XML-documents with the ftp-server. Then, in automatic mode analysis, XML-documents in the course of which stand out meta-data needed to populate the template ftp – server АС ООС (ftp://free:[email protected])

User-interface Site

Adjustment results

 

 



search. Next, the robot records the received meta-data into the database MySQL. Thus, data is collected without human intervention in the automatic mode, and prepared for further use. Thereby achieving savings of time for processing a user request. It should be noted that the robot works independently from the other components of the site and allows users during an update database operation to perform the normal site. Back-end (server part of the site) is also drawn to the database directly during execution of user requests. User query is formed according to the pattern in one of the four thematic blocks: 1. General information about the subjects of the contract system. 2. Information on the procurement planning stage. 3. Information on the steps of determining the supplier (contractor, executor). 4. Information on the stage of execution of contracts (civil contracts). The user specifies the boundaries of the request by determining the number of parameters. In accordance with usergenerated HTTP-request, the server generates a SQL-query to the local site database unloads XML-files, performs all calculations and provides visualization of the results, that is, formalizes them in tabular and graphical form. Organizational chart of the processes of interaction with the user database is presented in Figure 2.

Uploading XML - files (format ZIP - archive) analysis of documents in the database

Formation of the search query select the template keyword choice of parameters search query

Query processing server site

Visualization of search query results  table view  graphical view

User action regarding the results of a search query

Saving and printing results in Personal Area (for registered users) to external media

Forming the base metadata database

Formation and direction of SQL - query

Uploading XML - files

Processing results search query  data analysis  perform calculations

Shutdown the system

Fig. 2 Scheme of the processes of interaction with the user of the website database

To demonstrate the capabilities of the site give an example of the formation and processing a user request to the database. Name of a search query - "Register of Members procurement - evaluation activity." Because the value has structure and composition of the metadata generated by the results of a search query, for clarity, should be included in the algorithm an example step of loading the ftp-server primary XML-documents. Through interaction with adjacent systems AC OOC made the transfer of information into two main streams: the draft documents on related systems in the AC OOC and documents the final version of the AC OOC in the external speaker system placing your order. Meta-data required for processing the user's

request on the site, generated from XML-files hosted on ftpserver and contain the following information:  a notice of a purchase (by way of placing procurement);  information about purchasing documents in unstructured form;  general information about the object of procurement;  protocol of opening envelopes and opening up access to electronic documents participants' bids (by way of placing procurement);  protocol review and assessment of applications for participation (by way of placing procurement);  general information about the object of procurement and structured protocol review and assessment of

applications for participation in the request for quotations without placing a notice;  information on the state or municipal contract (on execution (termination) of the contract, the cancellation of the contract);  protocol to waive the contract;  result of the procedure defined by the supplier. After unloading the XML-files from ftp-server database contains all the meta-data for analysis and processing a user request. For the formation of a search query, the user selects a theme unit (one of four) in which then selects a search pattern and generates a search query by sampling the search parameters. To demonstrate an example of the user in the thematic section "General information about the subjects of the contract system." This unit is designed to generate a search query on the roster of customers, suppliers (contractors, performers) on various grounds:  participation in the procurement (including differentiated: purchased by name products under the name of the participant or the customer, according to the method of placement of procurement, on the status of procurement, over the period of placement of purchase (participation in procurement), dates from the control of the procurement process, on the basis of purchases);  conclusion and execution of the contract (including differentiated: by name of the purchased products, under the name of the participant or the customer, according to the method of placement procurement on the status of the contract, the reference date for the process of concluding and executing a contract, on the basis of purchases). Defining the thematic section, the user goes to the list of search query patterns. Next, the user selects one of the templates. For each pattern, characterized by a certain set of criteria. The search query is formed by a set of criteria the user selects from a list of possible template for each search. When defining search

criteria the user is guided by established procedures defined criteria. The user must also select the search results in the presence of options in the template - basic or enhanced presentation of the results. The difference between the forms is the amount of data provided. Results can be formalized in the data tables and (or) of the diagram. The tabular form is displayed automatically. Chart type is determined by the user's choice of options. As a result, query processing by the server generates SQL-query. Getting from the server SQL-query initiates unloading XML-files from the database and processing metadata. To illustrate an example of the formation and processing a user request within the cluster "General information about the subjects of the contract system" provide a description of the work to the search query from a template "Register of Members procurement - evaluation activity." The query result shows the data on participants procurement who participated in the procurement, and provides a measure of the activity of the participants, as well as:  Determine the number of participants involved in the procurement of a single type of product (i.e., to determine the market suppliers of these products);  To identify the frequency of contracts (i.e., to determine the effectiveness of the involvement in procurement);  To identify the frequency of contracts with individual customers;  Determine the level of discipline execution of the contract procurement and other participants. Essential criteria search criterion is "the name of the purchased products", which provides an indication of the purchased goods (works, services). Query is formed in relation to a particular type of product purchased using the criterion of "qualifier code ARCPEA." The presentation of results - the table. List of criteria for a search query, which are determined by the user of the site is presented in Table 1.

Table 1 Criteria for a search query from a template № п/п

Name of a search criterion

Option sample

1

name of purchased product

one of the many

2

qualifier code ARCPEA

one of the many

3

participant's name

one of the many; many of many

4

the name of the winner

one of the many; many of many

5

method of procurement

one of the many; many of many

6

region of purchase

one of the many; many of many

7

choice of date

from ... to ....

8

choice of base

one of the many; many of many

9

the maximum number of lines per page of results

100

10

version number of lines per page of results (user's choice)

20; 50; 100

The procedure for compiling the search query is defined as follows. The user has the opportunity to define a set of search criteria. Mandatory criterion is the criterion of "the name of the purchased goods (works, services), which corresponds to the criterion of" qualifier code ARCPEA." Criteria of "party name" and "name of the winner" are identifying the character, if a user searches for a particular procurement (known) provider (or providers) on a particular name of the purchased products. Search results for criteria "participant's name" and "name of the winner" contains identifying information about the participant purchases - TIN,

PPC, legal address, belonging to the SMP, SONKO, the inclusion in the RNP . Criteria "region of purchase", "method of procurement" are intended to increase or decrease the number of search results by expanding or narrowing the range of search. The user can sort the information based on the criterion of "region of purchase" by one (several) regions or all regions. The user can sort the information based on the criterion of "method of procurement" by one (several) methods or all methods of procurement. The criterion of "date picker" is complementary and refines the search results. The criterion of "date picker" allows

detailing search (variation and / or) on the date of the decision to purchase a result, the date of conclusion of the contract. The user defines the time interval to search by date in the format "from ... to ...." Criteria "selection base", "maximum number of lines" are clarifying nature, they are designed to refine your search. The criterion of "choice base" enables search selection on the basis of purchasing 44-FL and (or) 223-FL. The criterion of "maximum number of lines" allows the user to split the search into pieces, the volume of which corresponds with the most user about displaying search results for further operations of his choice. Presentation of results at the request includes the

Name of the participant

The number of procurement, in which he participated

Number of contracts

The presentation of results (extended) includes the following parameters of the query result:  cost of purchase:  method of purchase:  region of purchase:  the date of the decision of the outcome of purchase: from ... to ....

Name of the The number Of these, participant of method of procurement placement , in which he purchases participated

following: basic and advanced. The presentation of results (base) includes the following parameters of the query result:  cost of purchase:  method of purchase:  region of purchase:  the date of the decision of the outcome of purchase: from ... to ....  the date of the contract: from ... to ....  base procurement:  maximum number of lines: The result of a search query in the base form is visualized in tabular form. Template visualization of the results is shown in Table 2. Table 2 The pattern of the search result table in the form of base The sum of the Date of last participation in Date of last contracts the procurement contract

  

the date of the contract: from ... to .... base procurement: maximum number of lines: The result of a search query in the expanded form is visualized in tabular form. Template imaging results given in Table 3.

Table 3 The pattern of the search result table in extended form Number of The sum of The sum Link to Date of last Date of contracts the for each of purchase participation last contracts the in the contract contracts procurement

The procedure for data conversion from XML-files hosted on ftp-server to the meta-data as a result of a search query is displayed in Figure 3. Name of purchased product Code ARCPEA

General information about the object of procurement

The protocol of opening envelopes and opening up access to electronic documents participants' bids

Name of the participant

Minutes of the review and evaluation of applications for participation

Information on the state and municipal contracts

Name winner

Protocol rejection of the contract

The notice on the procurement Information about purchasing document The result of the procedure for determining the supplier

The method of procurement Region of purchase Select a base Date Picker

Name of the participant The number of purchases, which involved Of these, method of placement purchases

Number of contracts The sum of the contracts The amount of each of the contracts

Date of last participation in the procurement Date of last concluded contract

Link to purchase

Fig. 3 The procedure for converting the data to form a result of a search query

Thus, the demonstration of the site for the formation and processing the results of a search query, within which the generation of analytical and statistical information based on data from ftp-server AC OOC. After receiving such data subject of public scrutiny in the area of procurement has the ability to analyze customer-purchasing activity, assess the effectiveness of procurement because of qualitative and quantitative indicators. Accumulation of meta-data in a local database site with ftp-server AC OOC regulations considering downloading updates can save processing time of a user request. The possibility of formalizing the search results make it possible to maximize visualization parameters procurement customers. All this improves the efficiency of procurement monitoring for public scrutiny in the area of public procurement.

References  MIME-Based Secure Peer-to-Peer Business Data Interchange Using HTTP, Applicability Statement 2 (AS2) / http://www.ietf.org/rfc/rfc4130.txt.  CMS Advanced Electronic Signatures (CadES) / CAdES Basic Electronic Signature (CAdES-BES) / http://tools.ietf.org/html/rfc5126.html#section-4.3.1.