Skip to main content

Coding Week 6

Meeting 0

Organizer

  • Gaurav Mishra

Attendees

  • Anupam Ghosh
  • Shaheem Azmal
  • Vasudev Maduri
  • Klaus Gmeinwieser
  • Omar AbdelSamea

Outcomes

  • Discussed the issue of having agents conf seperating between containers and the idle solution would be to add all agents conf to a database.
  • for database system discussed two options etcd and reddis.
  • Discussed how etcd should be used (seperate high availblity cluster vs deployment) and the discision was using a deployment as the seperate cluster for etcd only will be an overkill

Meeting 1

Organizer

  • Gaurav Mishra

Attendees

Organizer

  • Gaurav Mishra

Attendees

  • Anupam Ghosh
  • Vasudev
  • Ayush Bharadwaj
  • Shreya Singh
  • Kaushlendra Pratap Singh
  • Omar AbdelSamea

Outcomes

  • Made a small demo for working FOSSology installation applied with some hacks (agents conf and web UI)
  • Presented manifest of etcd (deployment, service and pvc).
  • Presented a concept of how etcd will be used inside scheduler code.

Migrating configurations from conf files to etcd

  • For microservice architecture each agent has it's own conf file inside it's pod.
  • FOSSology hosts needs to be hardcoded before deployment.
  • To solve this all conf files will be added to a key value pair database. The selected db system is etcd
  • for each new agent added, it'll interface with etcd using RESTful API. The agent will open it's conf file and start making proper PUT request to add configuration in etcd and the agent will add the host details.

End of the week result

  • Succesfully scaned files using copyright and nomos (some hacks are applied to get it working)
  • Compared etcd vs redis and at the end etcd will be used
  • Started migrating Hosts part from FOSSology conf to etcd by modfying scheduler_foss_config in scheduler

Diagrams and screenshots

Interface between k8s, scheduler and etcd.

image

First scanned file using microservice architecture

image