Skip to content
GitLab
  • Menu
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • U ucollect
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 0
    • Issues 0
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • Deployments
    • Deployments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • Turris
  • ucollect
  • Merge requests
  • !27

Amihacked support

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Ghost User requested to merge amihacked into master Nov 15, 2016
  • Overview 5
  • Commits 10
  • Changes 11

This implements common#33 (closed).

This code will feed the AmIHacked database with fresh data. There are two parts (that are connected). One does the initial export of archive data and import into the database. The other part stores the data that are being archived to separate files and adds it into the DB.

Parts of this don't really need to be part of ucollect. But the archivist already lives there and it makes more sense to have the code together.

While I'd like someone to have a fast scan through the code (it is in part perl, but there should be only short snippets of it), I'm already trying to put it into production (which takes time due to the data size).

And another note. I opted not to do the sorting inside postgres during the export, since I don't want to torture the DB disks as much and this is likely faster. And the SQL queries to merge all the sources together would be very complex.

Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: amihacked