214921 2020-07-29 08:30:32 -0700 Automatically delete old data from ews buildbot instance 2024-02-28 15:07:02 -0800 1 1 1 Unclassified WebKit Tools / Tests Other Unspecified Unspecified RESOLVED FIXED https://bugs.webkit.org/show_bug.cgi?id=218817 https://bugs.webkit.org/show_bug.cgi?id=224552 https://bugs.webkit.org/show_bug.cgi?id=270255 InRadar P2 Normal --- 1 aakash_jain aakash_jain aakash_jain ap jbedard ryanhaddad webkit-bug-importer oldest_to_newest 1675996 0 aakash_jain 2020-07-29 08:30:32 -0700 Automatically delete old data from ews-build. We can choose a time range, maybe 1 year, after which the build logs will be deleted, the build and status-bubble information will still be retained, just the detailed build logs will be deleted. We can use Buildbot's JanitorConfigurator for that (https://docs.buildbot.net/latest/manual/configuration/configurators.html#janitorconfigurator). 1675997 1 webkit-bug-importer 2020-07-29 08:30:57 -0700 <rdar://problem/66274920> 1709930 2 414810 aakash_jain 2020-11-23 12:09:51 -0800 Created attachment 414810 Patch 1709931 3 aakash_jain 2020-11-23 12:15:34 -0800 Since currently most of the infrastructure is down and there is almost no load on the server, I took this opportunity to run this on the server as well to delete logs older than 1 year. See: https://ews-build.webkit.org/#/builders/54/builds/1 After deleting the logs, the status-bubbles are still fully functional, buildbot builds are still accessible, just that the individual steps in the buildbot builds wouldn't show the logs, e.g.: https://ews-build.webkit.org/#/builders/19/builds/1 1710341 4 414957 aakash_jain 2020-11-27 10:36:59 -0800 Created attachment 414957 Patch 1710585 5 414957 jbedard 2020-11-30 06:43:40 -0800 Comment on attachment 414957 Patch I like this change, it seems like a happy medium between outright deleting old builds entirely and keeping them around in some for to run analytics over them. 1710599 6 ews-feeder 2020-11-30 07:05:11 -0800 commit-queue failed to commit attachment 414957 to WebKit repository. 1710601 7 ews-feeder 2020-11-30 07:09:01 -0800 Committed r270243: <https://trac.webkit.org/changeset/270243> All reviewed patches have been landed. Closing bug and clearing flags on attachment 414957. 414810 2020-11-23 12:09:51 -0800 2020-11-27 10:36:57 -0800 Patch bug-214921-20201123150950.patch text/plain 1449 aakash_jain SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDI3MDE2NSkKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDEzIEBACisyMDIwLTExLTIzICBBYWthc2ggSmFpbiAgPGFha2FzaF9qYWluQGFwcGxlLmNv bT4KKworICAgICAgICBBdXRvbWF0aWNhbGx5IGRlbGV0ZSBvbGQgZGF0YSBmcm9tIGV3cyBidWls ZGJvdCBpbnN0YW5jZQorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5j Z2k/aWQ9MjE0OTIxCisKKyAgICAgICAgUmV2aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAg ICAgICAgKiBDSVN1cHBvcnQvZXdzLWJ1aWxkL21hc3Rlci5jZmc6IENvbmZpZ3VyZWQgSmFuaXRv ckNvbmZpZ3VyYXRvciB0byBkZWxldGUgbG9ncyBvbGRlciB0aGFuIG9uZSB5ZWFyLCBhbmQKKyAg ICAgICAgY29uZmlndXJlZCB0byBydW4gZXZlcnkgc3VuZGF5IGVhcmx5IG1vcm5pbmcuCisKIDIw MjAtMTEtMjEgIEppZXdlbiBUYW4gIDxqaWV3ZW5fdGFuQGFwcGxlLmNvbT4KIAogICAgICAgICBb V2ViQXV0aG5dIEltcGxlbWVudCBTUEkgZm9yIEF1dGhlbnRpY2F0aW9uU2VydmljZXMuRnJhbWV3 b3JrCkluZGV4OiBUb29scy9DSVN1cHBvcnQvZXdzLWJ1aWxkL21hc3Rlci5jZmcKPT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PQotLS0gVG9vbHMvQ0lTdXBwb3J0L2V3cy1idWlsZC9tYXN0ZXIuY2ZnCShyZXZpc2lvbiAyNzAx NjUpCisrKyBUb29scy9DSVN1cHBvcnQvZXdzLWJ1aWxkL21hc3Rlci5jZmcJKHdvcmtpbmcgY29w eSkKQEAgLTMsNiArMyw3IEBAIGltcG9ydCBzb2NrZXQKIGltcG9ydCBzeXMKIAogZnJvbSBidWls ZGJvdC5wbHVnaW5zIGltcG9ydCByZXBvcnRlcnMsIHV0aWwKK2Zyb20gZGF0ZXRpbWUgaW1wb3J0 IHRpbWVkZWx0YQogCiBpbXBvcnQgbG9hZENvbmZpZwogZnJvbSBldmVudHMgaW1wb3J0IEV2ZW50 cwpAQCAtNjIsNiArNjMsOSBAQCBlbHNlOgogY1snbG9nQ29tcHJlc3Npb25NZXRob2QnXSA9ICds ejQnCiBjWydidWlsZGJvdE5ldFVzYWdlRGF0YSddID0gTm9uZQogCisjIGNvbmZpZ3VyZSBhIGph bml0b3IgdG8gZGVsZXRlIG9sZCBsb2dzCitjWydjb25maWd1cmF0b3JzJ10gPSBbdXRpbC5KYW5p dG9yQ29uZmlndXJhdG9yKGxvZ0hvcml6b249dGltZWRlbHRhKHdlZWtzPTUyKSwgaG91cj0nMScs IGRheU9mV2Vlaz0nNicpXQorCiBsb2FkQ29uZmlnLmxvYWRCdWlsZGVyQ29uZmlnKGMsIGlzX3Rl c3RfbW9kZV9lbmFibGVkPWlzX3Rlc3RfbW9kZV9lbmFibGVkKQogCiBtYWlsX25vdGlmaWVyID0g cmVwb3J0ZXJzLk1haWxOb3RpZmllcigK 414957 2020-11-27 10:36:59 -0800 2020-11-30 07:09:01 -0800 Patch bug-214921-20201127133658.patch text/plain 1457 aakash_jain SW5kZXg6IFRvb2xzL0NoYW5nZUxvZwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBUb29scy9DaGFuZ2VMb2cJKHJl dmlzaW9uIDI3MDE5OCkKKysrIFRvb2xzL0NoYW5nZUxvZwkod29ya2luZyBjb3B5KQpAQCAtMSwz ICsxLDEzIEBACisyMDIwLTExLTI3ICBBYWthc2ggSmFpbiAgPGFha2FzaF9qYWluQGFwcGxlLmNv bT4KKworICAgICAgICBBdXRvbWF0aWNhbGx5IGRlbGV0ZSBvbGQgZGF0YSBmcm9tIGV3cyBidWls ZGJvdCBpbnN0YW5jZQorICAgICAgICBodHRwczovL2J1Z3Mud2Via2l0Lm9yZy9zaG93X2J1Zy5j Z2k/aWQ9MjE0OTIxCisKKyAgICAgICAgUmV2aWV3ZWQgYnkgTk9CT0RZIChPT1BTISkuCisKKyAg ICAgICAgKiBDSVN1cHBvcnQvZXdzLWJ1aWxkL21hc3Rlci5jZmc6IENvbmZpZ3VyZWQgSmFuaXRv ckNvbmZpZ3VyYXRvciB0byBkZWxldGUgbG9ncyBvbGRlciB0aGFuIG9uZSB5ZWFyLCBhbmQKKyAg ICAgICAgY29uZmlndXJlZCB0byBydW4gZXZlcnkgbW9ybmluZy4KKwogMjAyMC0xMS0yNyAgQ2Fy bG9zIEdhcmNpYSBDYW1wb3MgIDxjZ2FyY2lhQGlnYWxpYS5jb20+CiAKICAgICAgICAgW0dUS10g TWluaUJyb2VzZXIgYWRkIGFuIG9wdGlvbiB0byBxdWl0IHRoZSBicm93c2VyIGFmdGVyIGxvYWRp bmcgZmluaXNoZXMKSW5kZXg6IFRvb2xzL0NJU3VwcG9ydC9ld3MtYnVpbGQvbWFzdGVyLmNmZwo9 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09Ci0tLSBUb29scy9DSVN1cHBvcnQvZXdzLWJ1aWxkL21hc3Rlci5jZmcJKHJldmlz aW9uIDI3MDE5OCkKKysrIFRvb2xzL0NJU3VwcG9ydC9ld3MtYnVpbGQvbWFzdGVyLmNmZwkod29y a2luZyBjb3B5KQpAQCAtMyw2ICszLDcgQEAgaW1wb3J0IHNvY2tldAogaW1wb3J0IHN5cwogCiBm cm9tIGJ1aWxkYm90LnBsdWdpbnMgaW1wb3J0IHJlcG9ydGVycywgdXRpbAorZnJvbSBkYXRldGlt ZSBpbXBvcnQgdGltZWRlbHRhCiAKIGltcG9ydCBsb2FkQ29uZmlnCiBmcm9tIGV2ZW50cyBpbXBv cnQgRXZlbnRzCkBAIC02Miw2ICs2Myw5IEBAIGVsc2U6CiBjWydsb2dDb21wcmVzc2lvbk1ldGhv ZCddID0gJ2x6NCcKIGNbJ2J1aWxkYm90TmV0VXNhZ2VEYXRhJ10gPSBOb25lCiAKKyMgY29uZmln dXJlIGEgamFuaXRvciB0byBkZWxldGUgb2xkIGxvZ3MKK2NbJ2NvbmZpZ3VyYXRvcnMnXSA9IFt1 dGlsLkphbml0b3JDb25maWd1cmF0b3IobG9nSG9yaXpvbj10aW1lZGVsdGEod2Vla3M9NTIpLCBo b3VyPScxJywgZGF5T2ZXZWVrPScqJyldCisKIGxvYWRDb25maWcubG9hZEJ1aWxkZXJDb25maWco YywgaXNfdGVzdF9tb2RlX2VuYWJsZWQ9aXNfdGVzdF9tb2RlX2VuYWJsZWQpCiAKIG1haWxfbm90 aWZpZXIgPSByZXBvcnRlcnMuTWFpbE5vdGlmaWVyKAo=