Compare commits
2
Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
63ced7b44a | ||
|
|
6dec2c1469 |
No files matched your search
@@ -0,0 +1,25 @@
|
||||
name: Owned disk maintenance only
|
||||
on:
|
||||
push:
|
||||
branches:
|
||||
- ops/bounded-disk-20261119
|
||||
jobs:
|
||||
maintenance:
|
||||
runs-on: canina
|
||||
steps:
|
||||
- name: Test and install bounded maintenance without app deployment
|
||||
env:
|
||||
SHA: ${{ github.sha }}
|
||||
run: |
|
||||
set -eu
|
||||
umask 077
|
||||
case "$SHA" in *[!0-9a-f]*|'') exit 2;; esac
|
||||
[ "${#SHA}" -eq 40 ]
|
||||
mkdir -p disk-maintenance
|
||||
cd disk-maintenance
|
||||
export no_proxy=git.parsaaghayi.ir,localhost,127.0.0.1
|
||||
for name in managed-disk.py test-managed-disk.py install-managed-disk.py; do
|
||||
wget --no-proxy -qO "$name" "https://git.parsaaghayi.ir/parsa/canina/raw/commit/$SHA/scripts/$name"
|
||||
done
|
||||
python3 -B test-managed-disk.py
|
||||
tar -cf - managed-disk.py test-managed-disk.py install-managed-disk.py | ssh -F /dev/null -i /root/.ssh/id_ed25519 -p 2234 -o BatchMode=yes -o StrictHostKeyChecking=yes -o ConnectTimeout=15 devops@172.17.0.1 'sudo -n bash -c '\''set -eu; umask 077; d=$(mktemp -d /opt/services/canina/tmp/managed-disk-ci.XXXXXXXX); trap "rm -rf -- $d" EXIT; tar -xf - -C "$d"; GITHUB_ACTIONS=true python3 -B "$d/install-managed-disk.py"; python3 -B /opt/services/canina/.managed-disk/managed-disk.py; python3 -B /opt/services/canina/.managed-disk/managed-disk.py'\'''
|
||||
@@ -0,0 +1,29 @@
|
||||
# Owned disk maintenance
|
||||
|
||||
Installed only by `.gitea/workflows/managed-disk.yml` on the dedicated ops branch. This workflow never calls an application deployment. The daily system timer manages only unused >24h Docker builder cache (no --all, images, volumes or logs) and explicit marked test children under `/opt/services/canina/.managed-disk/tests`. Unmarked directories, Git/env/dependency-bearing trees, symlinks, mounts and open files are preserved. Tests use temporary roots, not privileged installer fixtures.
|
||||
|
||||
Shared heavy work entry point:
|
||||
|
||||
```
|
||||
python3 -B /opt/services/canina/.managed-disk/managed-disk.py build COMMAND ARG...
|
||||
```
|
||||
|
||||
Holds `.managed-disk/heavy.lock` for the entire subprocess and requires >=20GiB available immediately before execution. This is an installed opt-in guard, NOT a global reservation: existing application build dispatchers do not yet acquire it. Migration of each dispatcher belongs in its reviewed release CI. Do not claim shared serialization is complete until all producers adopt it. Current lower headroom intentionally rejects new guarded heavy builds.
|
||||
|
||||
No existing test artifacts are automatically marked. New disposable tests may create `.disposable-test` containing exactly `canina-managed-test-v1\n`; expiry is seven days. Tests must acquire the same lock when creating/using that namespace. Existing source/donor/archive paths are outside this policy.
|
||||
|
||||
## Container log gate
|
||||
|
||||
Fresh inspection confirms older containers including Traefik, Nexus and databases have `json-file` with empty options. The daemon already has defaults; these do not retrofit existing containers. The exact per-service Compose option for the next separately authorized release is:
|
||||
|
||||
```yaml
|
||||
logging:
|
||||
driver: json-file
|
||||
options:
|
||||
max-size: "10m"
|
||||
max-file: "3"
|
||||
```
|
||||
|
||||
Do not apply a broad override or recreate these services now. Traefik/DB/VPN downtime is not authorized. No live log truncation is permitted. Each affected service's managed Compose source must receive the scoped option through its own existing release path, followed by explicit downtime approval and a verified recreation. This document is a configuration recommendation, not an installed log-rotation change.
|
||||
|
||||
No historical backup staging, cloud history, named volume, source checkout or protected review image is retired by this maintenance.
|
||||
@@ -0,0 +1,19 @@
|
||||
#!/usr/bin/env python3
|
||||
"""Host maintenance only; never deploy/recreate an application."""
|
||||
import os,pathlib,subprocess
|
||||
if os.environ.get('GITHUB_ACTIONS')!='true' or os.getuid()!=0 or pathlib.Path('/.dockerenv').exists():raise SystemExit('Authenticated host CI required')
|
||||
r=pathlib.Path('/opt/services/canina/.managed-disk')
|
||||
if r.is_symlink() or r.resolve()!=r:raise SystemExit('unsafe destination')
|
||||
r.mkdir(mode=0o700,exist_ok=True);(r/'tests').mkdir(mode=0o700,exist_ok=True)
|
||||
for n in ['managed-disk.py','test-managed-disk.py']:
|
||||
p=r/n
|
||||
if p.is_symlink():raise SystemExit('unsafe destination file')
|
||||
p.write_bytes(pathlib.Path(__file__).with_name(n).read_bytes());p.chmod(0o600)
|
||||
(r/'heavy.lock').touch(mode=0o600,exist_ok=True)
|
||||
subprocess.run(['python3','-B',str(r/'test-managed-disk.py')],check=True)
|
||||
u=pathlib.Path('/etc/systemd/system')
|
||||
(u/'canina-managed-disk.service').write_text('[Unit]\nDescription=Bounded owned disposable disk retention\n[Service]\nType=oneshot\nExecStart=/usr/bin/python3 -B /opt/services/canina/.managed-disk/managed-disk.py\nNice=15\nIOSchedulingClass=idle\nNoNewPrivileges=true\n')
|
||||
(u/'canina-managed-disk.timer').write_text('[Unit]\nDescription=Daily conservative disposable retention\n[Timer]\nOnCalendar=*-*-* 07:30:00 UTC\nRandomizedDelaySec=15min\nPersistent=true\n[Install]\nWantedBy=timers.target\n')
|
||||
subprocess.run(['systemctl','daemon-reload'],check=True)
|
||||
subprocess.run(['systemctl','enable','--now','canina-managed-disk.timer'],check=True)
|
||||
subprocess.run(['systemctl','is-active','--quiet','canina-managed-disk.timer'],check=True)
|
||||
@@ -0,0 +1,56 @@
|
||||
#!/usr/bin/env python3
|
||||
"""Owned opt-in test expiry, conservative unused cache, and shared build guard."""
|
||||
import pathlib,os,time,shutil,fcntl,subprocess,json,sys
|
||||
BASE=pathlib.Path('/opt/services/canina/.managed-disk')
|
||||
RESERVE=20*1024**3
|
||||
|
||||
def retire(root,now=None,protected=()):
|
||||
root=pathlib.Path(root);now=time.time() if now is None else now
|
||||
if root.is_symlink() or root.resolve()!=root:raise RuntimeError('unsafe root')
|
||||
removed=[]
|
||||
for p in sorted(root.iterdir()):
|
||||
marker=p/'.disposable-test'
|
||||
if p.is_symlink() or not p.is_dir() or p.resolve()!=p:continue
|
||||
if not marker.is_file() or marker.is_symlink() or marker.read_text()!='canina-managed-test-v1\n':continue
|
||||
if now-p.stat().st_mtime<7*86400:continue
|
||||
if any(v==str(p) or v.startswith(str(p)+'/') or str(p).startswith(v.rstrip('/')+'/') for v in protected):continue
|
||||
if os.path.ismount(p):continue
|
||||
# Unknown/source-bearing contents are never eligible; symlinks are never followed.
|
||||
if any(x.name in {'.git','.env','node_modules','vendor'} or x.is_symlink() or os.path.ismount(x) for x in p.rglob('*')):continue
|
||||
users=[]
|
||||
for proc in pathlib.Path('/proc').glob('[0-9]*'):
|
||||
for q in [proc/'cwd',proc/'root',*(proc/'fd').glob('*')]:
|
||||
try:
|
||||
v=os.readlink(q)
|
||||
if v==str(p) or v.startswith(str(p)+'/'):users.append(v)
|
||||
except OSError:pass
|
||||
if users:continue
|
||||
shutil.rmtree(p);removed.append(p.name)
|
||||
return removed
|
||||
|
||||
def busy():
|
||||
for p in pathlib.Path('/proc').glob('[0-9]*'):
|
||||
try:
|
||||
args=(p/'cmdline').read_bytes().replace(b'\0',b' ').decode(errors='replace')
|
||||
if any(x in args for x in ['docker build','compose build','next build','npm ci','npm install','composer install','rclone rcat']):return True
|
||||
except OSError:continue
|
||||
return False
|
||||
|
||||
def main():
|
||||
if BASE.is_symlink() or BASE.resolve()!=BASE:raise SystemExit('unsafe state root')
|
||||
with (BASE/'heavy.lock').open('a') as lock:
|
||||
fcntl.flock(lock,fcntl.LOCK_EX|fcntl.LOCK_NB)
|
||||
if sys.argv[1:2]==['build']:
|
||||
free=shutil.disk_usage(BASE).free
|
||||
if free<RESERVE:raise SystemExit('Insufficient available capacity: 20GiB required')
|
||||
if not sys.argv[2:]:raise SystemExit('command required')
|
||||
raise SystemExit(subprocess.call(sys.argv[2:]))
|
||||
if busy():raise SystemExit('Active heavy work: retention deferred')
|
||||
before=shutil.disk_usage(BASE).free
|
||||
ids=subprocess.check_output(['docker','ps','-aq'],text=True).split()
|
||||
containers=json.loads(subprocess.check_output(['docker','inspect',*ids],text=True)) if ids else []
|
||||
protected=[m['Source'] for c in containers for m in c['Mounts']]
|
||||
removed=retire(BASE/'tests',protected=protected)
|
||||
p=subprocess.run(['docker','builder','prune','--force','--filter','until=24h'],capture_output=True,text=True,timeout=300,check=True)
|
||||
print(json.dumps({'removed_tests':removed,'docker_cache_result':p.stdout.strip(),'available_before':before,'available_after':shutil.disk_usage(BASE).free}))
|
||||
if __name__=='__main__':main()
|
||||
@@ -0,0 +1,25 @@
|
||||
import importlib.util,pathlib,tempfile,unittest,os,time
|
||||
spec=importlib.util.spec_from_file_location('disk',pathlib.Path(__file__).with_name('managed-disk.py'))
|
||||
class Tests(unittest.TestCase):
|
||||
def test_expiry_and_escape(self):
|
||||
self.assertTrue(pathlib.Path(spec.origin).exists(),'managed retention implementation missing')
|
||||
m=importlib.util.module_from_spec(spec);spec.loader.exec_module(m)
|
||||
with tempfile.TemporaryDirectory() as d:
|
||||
r=pathlib.Path(d);old=r/'old';old.mkdir();(old/'.disposable-test').write_text('canina-managed-test-v1\n');(old/'result').write_text('fixture');os.utime(old,(1,1))
|
||||
unknown=r/'unknown';unknown.mkdir();os.utime(unknown,(1,1))
|
||||
outside=r/'source';outside.mkdir();(outside/'important').write_text('preserve');os.symlink(outside,r/'escape')
|
||||
self.assertEqual(m.retire(r,now=time.time()),['old']);self.assertEqual(m.retire(r,now=time.time()),[])
|
||||
self.assertTrue((outside/'important').exists());self.assertTrue(unknown.exists());self.assertTrue((r/'escape').is_symlink())
|
||||
def test_open_artifact_is_preserved(self):
|
||||
m=importlib.util.module_from_spec(spec);spec.loader.exec_module(m)
|
||||
with tempfile.TemporaryDirectory() as d:
|
||||
r=pathlib.Path(d);p=r/'busy';p.mkdir();(p/'.disposable-test').write_text('canina-managed-test-v1\n');f=(p/'result').open('w');os.utime(p,(1,1))
|
||||
try:self.assertEqual(m.retire(r),[])
|
||||
finally:f.close()
|
||||
self.assertEqual(m.retire(r),['busy'])
|
||||
def test_mounted_artifact_is_preserved(self):
|
||||
m=importlib.util.module_from_spec(spec);spec.loader.exec_module(m)
|
||||
with tempfile.TemporaryDirectory() as d:
|
||||
r=pathlib.Path(d);p=r/'mounted';p.mkdir();(p/'.disposable-test').write_text('canina-managed-test-v1\n');os.utime(p,(1,1))
|
||||
self.assertEqual(m.retire(r,protected=[str(p/'result')]),[])
|
||||
if __name__=='__main__':unittest.main()
|
||||
Reference in new issue
Block a user