This repository was archived by the owner on Feb 18, 2025. It is now read-only.

Orchestrator. New seeding algorithm, support for different seed methods and agent redesign#1120

Open

MaxFedotov wants to merge 78 commits into

openark:masterfrom

MaxFedotov:orchestrator_agent_dev

Commits on Jan 14, 2020

orchestrator-agent redesign. Structures
Maksim Fedotov
committed

Commits on Jan 16, 2020

agent redesign. Add structures. Change submit-agent to post
Maksim Fedotov
committed

Commits on Feb 4, 2020

support new agent logic p1. Add seedmethod
Maksim Fedotov
committed
Merge branch 'master' into orchestrator_agent_dev
Maksim Fedotov
committed

Commits on Feb 5, 2020

agent. refactor seeding p1
Maksim Fedotov
committed

Commits on Feb 10, 2020

agent. refactore agent hosts and seeding p2
Maksim Fedotov
committed

Commits on Feb 11, 2020

agent. refactor agent struct and methods
Maksim Fedotov
committed

Commits on Feb 12, 2020

agent. new seed process
Maksim Fedotov
committed

Commits on Feb 16, 2020

update vendor dependencies for dockertest package
Maksim Fedotov
committed
functional tests for agent + bugfix
Maksim Fedotov
committed

Commits on Feb 17, 2020

add tests for seed processing + bugfix
Maksim Fedotov
committed

Commits on Feb 18, 2020

add more tests + bugfix
Maksim Fedotov
committed

Commits on Feb 19, 2020

redesign agent tests
Maksim Fedotov
committed
add more tests + bugfix
Maksim Fedotov
committed

Commits on Feb 20, 2020

add post-seed-cmd for agent
Maksim Fedotov
committed
add more tests + bugfix
Maksim Fedotov
committed
instance_dao unmarshall count_mysql_snaphosts from db
Maksim Fedotov
committed
instance_dao make InitializeInstanceDao public in order to run tests
Maksim Fedotov
committed
agent remove MySQLVersion, as Orchestrator already know it
Maksim Fedotov
committed
additional checks for new seed. AbortSeed + tests
Maksim Fedotov
committed
ContinuousSeedProcess only on leader
Maksim Fedotov
committed
move agent commands to agent.go; update cli and api
Maksim Fedotov
committed

Commits on Feb 21, 2020

remove unused agent variables from config
Maksim Fedotov
committed
api use getagentinfo
Maksim Fedotov
committed
add ReadFailedSeeds, ReadErroredSeeds + tests
Maksim Fedotov
committed
add additional checks that targetInstance is not slave or master
Maksim Fedotov
committed

Commits on Feb 28, 2020

skip drop statements when using sqlite
Maksim Fedotov
committed
replace chen isMaster to len(SlaveHosts) when starting seed
Maksim Fedotov
committed
fix bug with agent discovery during seed
Maksim Fedotov
committed
fix logging in seed stages
Maksim Fedotov
committed

Commits on Mar 2, 2020

agent_http. unmarshall error message from agent in case of 500 response
Maksim Fedotov
committed
seed. Swap ConnectSlave and Cleanup stages
Maksim Fedotov
committed
agent_test. Update tests. Create docker containers before running suite
Maksim Fedotov
committed
seed ConnectSlave. Stop slave threads if they are running before executing reset slave;
Maksim Fedotov
committed

Commits on Mar 3, 2020

rename SeedProcessIntervalMinutes to SeedProcessIntervalSeconds
Maksim Fedotov
committed
seed ConnectSlave. Log additional seed stage info
Maksim Fedotov
committed
SeedBackupStaleFailMinutes. Fail seed in backup stage if no data copied
Maksim Fedotov
committed

Commits on Mar 4, 2020

seed. Use databases size instead of mysql datadir size in backup messages
Maksim Fedotov
committed

Commits on Mar 5, 2020

seed. SeedBackupStaleFailMinutes for restore if seeding to backupdir
Maksim Fedotov
committed
seed. user real database size instead of mysql datadir spaces used in restore progress calculations"
Maksim Fedotov
committed
ProcessSeeds log only if had active seeds
Maksim Fedotov
committed

Commits on Mar 6, 2020

support changes in tables for sqlite. Add indexes
Maksim Fedotov
committed
seed. Add timestamp to seedstagedetails
Maksim Fedotov
committed
fix typo in log message in NewSeed
Maksim Fedotov
committed

Commits on Mar 9, 2020

use seedHost in backup to support xtrabackup\lvm
Maksim Fedotov
committed
seed. Fix a bug in restore when BackupToDatadir == true
Maksim Fedotov
committed
change details text NOT NULL in agent_seed_state table
Maksim Fedotov
committed

Commits on Mar 10, 2020

seed. Use time.now() when submitting seedState
Maksim Fedotov
committed
seed. use error instead of failed status
Maksim Fedotov
committed

Commits on Mar 11, 2020

agent. add CreatedAt for LogicalVolume
Maksim Fedotov
committed
seed. additional lvm checks
Maksim Fedotov
committed

Commits on Mar 12, 2020

skip AddReplicaKey if it is specified in config.Config.DiscoveryIgnoreReplicaHostnameFilters
Maksim Fedotov
committed
Merge branch 'skip_adding_replicas' into orchestrator_agent_dev
Maksim Fedotov
committed

Commits on Mar 13, 2020

seed. Log backup\restore progress event if size not changed
Maksim Fedotov
committed

Commits on Mar 16, 2020

seed. Move creating of progress tracking stucts to processRunning
Maksim Fedotov
committed

Commits on Mar 28, 2020

add UI for agents\seeds. Add additional APIs for UI. Fix bugs with abortseed. Add additonal agents info to structs
Maksim Fedotov
committed

Commits on Mar 31, 2020

agent UI. add confirmation dialog for agent-commands
Maksim Fedotov
committed
update orchestrator css
Maksim Fedotov
committed
orchestrator js fix bug with toHumanFormat func if bytes is 0
Maksim Fedotov
committed

Commits on Apr 1, 2020

seed. fix a bug with processrunning on prepare stage
Maksim Fedotov
committed
agent UI. add forgotten action for discover button
Maksim Fedotov
committed

Commits on Apr 2, 2020

agent bugfix. wrong cluster alias shown on agents page
Maksim Fedotov
committed
agents ui bugfix. user /web/cluster link for cluster page
Maksim Fedotov
committed

Commits on Apr 3, 2020

add agent-data api endpoint
Maksim Fedotov
committed
remove unnecessary isAuthorizedForAction check for information agent\seed endpoints
Maksim Fedotov
committed

Commits on Apr 4, 2020

seed. when using abort always call abort api for target agent on prepare stage wil backupside=source, as there will be active socat waiting for connections
Maksim Fedotov
committed

Commits on Apr 6, 2020

add agents-failed-seeds api
Maksim Fedotov
committed

Commits on Apr 9, 2020

Merge branch 'master' into orchestrator_agent_dev
Maksim Fedotov
committed
update agents docs
Maksim Fedotov
committed

Commits on Apr 12, 2020

merge branch 'master' into orchestrator_agent_dev
Maksim Fedotov
committed
fix build errors
Maksim Fedotov
committed
fix build errors p1
Maksim Fedotov
committed
fix build errors p2
Maksim Fedotov
committed
fix build errors p3
Maksim Fedotov
committed

Commits on Apr 17, 2020

bugfix. Seed set inst.GTIDHintForce only if master.UsingGTID(). /api/agent wrong check for err!= nil
Maksim Fedotov
committed

Commits on Apr 21, 2020

bugfix. Active seed states not displayed on agent page
Maksim Fedotov
committed

Commits on Apr 22, 2020

bugfix. Active seed states not displayed on agent page
Maksim Fedotov
committed

Commits on Jun 16, 2020

seed. downtime target host in order to prevent clusterName flapping between hosts
Maksim Fedotov
committed