aboutsummaryrefslogtreecommitdiffstats
path: root/bridge/github/export.go
Commit message (Collapse)AuthorAgeFilesLines
* entity/dag: proper base operation for simplified implementationMichael Muré2022-07-251-1/+2
| | | | | | | | - reduce boilerplace necessary to implement an operation - consolidate what an operation is in the core, which in turn pave the way for a generic cache layer mechanism - avoid the previously complex unmarshalling process - support operation metadata from the core - simplified testing
* github: fix data race when closing event channelMichael Muré2022-06-051-14/+1
| | | | | | | | | | I believe the issue was twofold: When done importing, the calling context is likely still valid, so if the output channel is not read enough and reach capacity, some event producer down the line can be blocked trying to send in that channel. When closing it, this send is still trying to proceed, which is illegal in go. In rateLimitHandlerClient, there was a need to 2 different type of output channel: core.ExportResult and ImportEvent. To do so, the previous code was using a single channel type RateLimitingEvent and a series of goroutines to read/cast/send to the final channel. This could result in more async goroutine being stuck trying to send in an at-capacity channel. Instead, the code now use a simple synchronous callback to directly push to the final output channel. No concurrency needed anymore and the code is simpler. Any of those fixes could have resolved the data race, but both fixes is more correct.
* feature: Github bridge mutation rate limit (#694)rng-dynamics2021-09-141-64/+55
| | | Unified handling of rate limiting of github graphql api
* github: minor cleanupsMichael Muré2021-04-091-2/+2
|
* bug: migrate to the DAG entity structure!Michael Muré2021-02-141-1/+1
|
* bug: harmonize how time are used, fix some issues in command special formatsMichael Muré2020-06-251-1/+1
| | | | This assume that the convertion from time.Time <--> Unix timestamp is lossless which seems to be.
* bridge: record the login used during the configure and use it as default ↵Michael Muré2020-02-231-27/+20
| | | | | | credential fix #338
* bridges: pass the context to Init for when a client build process needs itMichael Muré2020-02-151-1/+1
|
* bridges: massive refactorMichael Muré2020-02-151-8/+8
| | | | | | - automatic flag validation and warning - generalized prompt - cleanups
* it compiles \o/Michael Muré2020-02-081-1/+1
|
* gitlab also compileMichael Muré2020-02-081-1/+4
|
* more more wipMichael Muré2020-02-081-6/+35
|
* more wipMichael Muré2020-02-081-30/+15
|
* bridge: huge refactor to accept multiple kind of credentialsMichael Muré2019-12-081-42/+66
|
* bridge/github: use core.ConfigKeyToken instead of keyTokenamine2019-11-231-3/+3
|
* bridge/github: export correctly emit nothing eventsamine2019-11-191-23/+17
|
* bridge/launchpad: add missing metadataamine2019-11-191-6/+6
| | | | bridge: use a specific key for origin metadata
* bug: rename RGBA to Colorludovicm672019-10-151-1/+1
|
* bridge/github: fix name case sensitivity in retrieving and creating labels ↵Amine Hilaly2019-08-191-14/+44
| | | | using github graphql api
* bridge/gthub: use errgroup.Group instead of sync.WaitGroupAmine Hilaly2019-08-181-28/+13
|
* bridge/core: add context.Context to ImportAll and ExportAll signaturesAmine Hilaly2019-08-181-69/+71
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | bridge/core: add ImportResult objects to stream import events bridge/core: launchpad support asynchronous import bridge/github: cancellable export and import functions bridge/gitlab: cancellable export and import functions commands: bridge pull/push gracefull kill bridge/github: fix github import bridge/github: use simple context for imports bridge/core: name parameters in interfaces github/core: Add EventError to export and import events types bridge/gitlab: add context support in gitlab requests functions bridge/gitlab: remove imported events count from importer logic bridge/github: remove imported events count from importer logic bridge/github: add context support in query and muration requets bridge/github: fix bug duplicate editions after multiple calls bridge/core: import import and export events String methods bridge/gitlab: fix error handling in note import events commands/bridge: Add statistics about imports and exports bridge/gitlab: properly handle context cancellation bridge/github: improve error handling bridge: break iterators on context cancel or timeout bridge: add context timeout support bridge: improve event formating and error handling commands: handle interrupt and switch cases bridge/github: add export mutation timeouts bridge: fix race condition bug in the github and gitlab importers bridge/github: improve context error handling
* finish the refactoring for the dedicated identifier typeMichael Muré2019-08-121-25/+26
|
* github: fix bad refactorMichael Muré2019-08-081-1/+1
|
* fix everything following the hash-->id changeMichael Muré2019-08-081-43/+16
|
* [bridge/github] ignore imported bugs from other repositoriesAmine Hilaly2019-07-061-24/+18
|
* [bridge/github] improve export label change functionAmine Hilaly2019-07-051-34/+57
| | | | [bridge/core] rename `EventStatus` to `ExportEvent`
* [bridge/github] improve comments and documentationAmine2019-07-051-37/+40
| | | | | | [bridge/github] improve error handling and tests Co-Authored-By: Michael Muré <batolettre@gmail.com>
* [core] Implement ExportResultsAmine Hilaly2019-06-301-71/+114
| | | | | Use ExportResult chan to send export events Remove exportedBugs and exportedLabels
* [bug] add snapshot.GetCreateMetadata methodAmine Hilaly2019-06-301-33/+34
| | | | | | | | | | [bug] add snapshot.HasParticipant(id string) [bug] add snapshot.HasAnyParticipant(ids ...string) [bug] add snapshot.HasActor(id string) [bug] add snapshot.HasAnyActor(ids ...string) [bridge/github] improve comments [bridge/github] exporter tests: register deleteRepository in cleaner [bridge/github] tests rebase
* [bridge/github] Correcte some types and add commentsAmine Hilaly2019-06-241-7/+13
| | | | | | | | | | | | General improvements Co-Authored-By: Michael Muré <batolettre@gmail.com> empty array check an empty array is not nil Co-Authored-By: Michael Muré <batolettre@gmail.com>
* [bridge/github] simplify export operation hashsAmine Hilaly2019-06-241-26/+12
| | | | | | | | | | [bridge/github] exporter tests: add more test cases and global tests [bridge/github] rename export_query to export_mutation [bridge/github] exporter: Log number of exported issues and labels [bridge/github] Improve comments
* [bridge/github] exporter: Add test casesAmine Hilaly2019-06-241-1/+4
| | | | | | correct delete repo improve tests set user identity
* [bridge/github] correct label & comment edit mutations bugsAmine Hilaly2019-06-241-28/+32
|
* [bridge/github] create label: Generate hexColor from label rgbaAmine Hilaly2019-06-241-26/+32
|
* [bridge/github] use context.WithTimeout on all graphql queriesAmine Hilaly2019-06-241-10/+52
|
* [bridge/github] exporter: Improve error handlingAmine Hilaly2019-06-241-72/+67
| | | | | | [bridge/github] queries: use api v4 for getLabel / createLabel [bridge/github] add comments to getIdentityClient
* [misc] update man docs and completion scriptsAmine Hilaly2019-06-241-11/+16
| | | | | | [cache] BugCache: Fix set metadata raw [bridge/github] Fix graphql input objects
* [bridge/github] exporter: Check bug import originAmine Hilaly2019-06-241-3/+33
| | | | [bridge/github] export only allowed bugs
* [bridge/github] importer: tag imported issues with origin metadataAmine Hilaly2019-06-241-13/+13
| | | | [bridge/github] exporter: correct export signature and cache maps
* [bridge/github] cache user tokenAmine Hilaly2019-06-241-6/+11
| | | | | | | | fix import typo init tests verify issue
* [bridge/github] exporter: support multiple tokens/clientsAmine Hilaly2019-06-241-62/+83
|
* [bridge/github] update github bug exporterAmine Hilaly2019-06-241-88/+240
| | | | | - cache repository ID - cache all comment IDs
* [cache] BugCache: Add set metadata methodsAmine Hilaly2019-06-241-8/+5
| | | | | | [bridge/github] fix add/remove mutation requests [bridge/github] iterator: fix typo
* [bridge/github] exporter: add graphql functionalitiesAmine Hilaly2019-06-241-6/+436
| | | | | | | | | [bridge/github] graphql mutation objects [bridge/github] github create and get labels [bridge/github] repository node_id query [bridge/github] exporter: ignore old bugs and old operations [bridge/github] add update labels/status functionalities [bridge/github] exporter: cache labels while exporting
* [bridge/github] Add exporter implementationAmine Hilaly2019-06-241-0/+49