APT based offline repo (small yad-bash project)

[Member Xecure]

Helpful

Up

0

::

My post was lost to the spam filter. I will repost just in case:
Edit: Thanks for restoring the post.

Xecure wrote:

Thanks, marcelo. I have added your translations to the next version.

I think I have also solved the big dependency list problem. Applying skidoo’s suggestion of using a file (exclude.list) to filter packages, starting with the most basic “required” and “important” packages already installed, excluding those.
I have also replaced “apt-rdepends” with an experimental “compromise” option. I haven’t had that much time for testing it, so results may be worse than “2-levels” option.
If at some point installation fails after using “compromise” option, default back to “ALL” option.

Changes in words and adding a “Help” dialog for the configuration window is still waiting for me to have the time. I will try to use some of my freetime during the week to continue improving the script.

@marcelocripe. For the future, next time you see something go wrog, I only need the .repo file generated and the errors.log. the other files are generated based on the output of these two text files.
About registering it in a git repo, as stated in the first page, I have been updating the https://gitlab.com/nXecure/my-offline-repo git project. No intention right now to also register in github, as I don’t think i will be using it more than once.

PPC wrote:

– I add this problem before- using GTK buttons that don’t get translated- “help”(ajuda) and “close” (fechar) are not translated in several windows… (it’s a tiny problem- users do understand the icons on those buttons)

Checking this version, launching with
LANGUAGE=pt ./my-offline-repo.sh
translates all gtk buttons correctly. Maybe I need to try a different setting, but the gtk button translation seems to work on my end.

Thanks everyone for the feedback and ideas.

This week I have it a bit difficult to keep udating the script with new stuff. I hope testing the new “compromise” feature will not take too long.

Thanks all for your feedback.

• This reply was modified 2 years, 7 months ago by Xecure. Reason: Thanks moderator

Attachments:

1. my-offline-repo0103-1.zip

antiX Live system enthusiast.
General Live Boot Parameters for antiX.

[Member marcelocripe]

Helpful

Up

0

::

Xecure,

I installed antiX 12.2 64 bits full again (antiX-19.2_x64-full.iso), the system I was using was already with several errors and very slow after so many tests.

First test with the new version “my-offline-repo0103-1.zip”, I will do the tests without updating antiX 19.2, let’s see how it behaves.

Opera, 63 “.deb” packages, this time I selected the APT opera-stable option instead of the REPO opera_64 option, the installation started normally, as I described in detail in the post link: https://www.antixforum.com / forums / topic / apt-based-offline-repo-small-yad-bash-project / page / 5 / and Opera is working normally.

marcelocripe

————–

Xecure,

Eu instalei novamente o antiX 12.2 64 bits full (antiX-19.2_x64-full.iso), o sistema que eu estava usando já estava com vários erros e bem lento após tantos testes.

Primeiro teste com a nova versão “my-offline-repo0103-1.zip”, eu vou fazer os testes sem atualizar o antiX 19.2, vamos ver como ele se comporta.

Opera, 63 pacotes “.deb”, desta vez eu selecionei a opção APT opera-stable ao invés da opção REPO opera_64, a instalação iniciou normalmente, conforme eu descrevi com detalhes na postagem do link: https://www.antixforum.com/forums/topic/apt-based-offline-repo-small-yad-bash-project/page/5/ e Opera está funcionando normalmente.

marcelocripe

[Member marcelocripe]

Helpful

Up

0

::

opera_64_amd64.repo

INSTALL_PACKAGES=opera-stable
PACKAGE_DESCRIPTION=Opera browser
apt-transport-https
dbus
dbus-user-session
dconf-gsettings-backend
dconf-service
dirmngr
elogind
glib-networking
glib-networking-common
glib-networking-services
gnupg
gnupg-l10n
gnupg-utils
gpg
gpg-agent
gpgconf
gpgsm
gpg-wks-client
gpg-wks-server
gsettings-desktop-schemas
libasound2
libasound2-data
libassuan0
libatk-bridge2.0-0
libatspi2.0-0
libcairo-gobject2
libcolord2
libdbus-1-3:i386
libdconf1
libdrm2
libdrm-common
libepoxy0
libgbm1
libgtk-3-0
libgtk-3-common
libjson-glib-1.0-0
libjson-glib-1.0-common
libksba8
liblcms2-2
libldap-2.4-2
libldap-common
libnpth0
libnspr4
libnss3
libpam-elogind
libpam-systemd
libproxy1v5
libpsl5
librest-0.7-0
libsasl2-2
libsasl2-modules-db
libsoup2.4-1
libsoup-gnome2.4-1
libwayland-client0
libwayland-cursor0
libwayland-egl1
libwayland-server0
libx11-xcb1
libxcb-dri3-0
libxkbcommon0
libxss1
libxtst6
opera-stable
pinentry-curses
xkb-data

0_errors.log:
ter set 15 21:38:19 -03 2020 – Errors for package opera_64:amd64

[Member Xecure]

Helpful

Up

0

::

So it downloaded only 63 packages compared to the previous version that was almost 300. I think this is an improvement. Hopefully the “compromise” new option will work for most programs as well.
The real test will be downloading a package from backports (like libreoffice latest), mxrepo (gimp, for example) and outside repos (ala chrome).
I didn’t have the time for testing as many packages as possible. I will really have time during the weekend.

Thanks for your feedback.

antiX Live system enthusiast.
General Live Boot Parameters for antiX.

[Member Xecure]

Helpful

Up

0

::

I have tested many many packages (downloading and then installing on a vanilla antiX 19.2.1 base) and found that the new “compromise” option worked quite well. There was a problem downloading google-chrome and gimp, and the main culprit is the exclude.list file (it excluded libcups2 package, and it seems chrome and gimp need it).
If you change the contents of the exclude.list for the one in 19.2core-exclude (delete all text inside exclude.list, copy all content from 19.2core-exclude file, and paste it inside exclude.list and then save the file), the number of dependencies becomes larger but there are no install problems.

I have been working on adding a new option inside the script to let you download updates for later installing them in an offline system, but I still have a lot to test before I am ready to upload it. Once this is added, using a more aggressive exclude.list file to reduce the number of dependencies downloaded for each package would be viable and bring no/less problems.

I have updated the git project with skidoo’s proposed changes, but I still have to translate the new help windows and the text changes, so I won’t be uploading a new version here yet.
I will take this chance to thank skidoo for his help.

Anyways, no new updates anytime soon. Next week I hope I can upload a new version.

antiX Live system enthusiast.
General Live Boot Parameters for antiX.

[Anonymous]

Helpful

Up

0

::

a more aggressive exclude.list file

food for thought:
Since at least as far back as antiX16, the following is present within the ISO
(at least for “full”, “base”, and “core” editions ~~ you might also check for “net” ISO)
/usr/share/antiX/installed-packages.txt

Since the program’s target audience will likely be users of current antiX 19, you might consider blacklisting any package mentioned within the installed-packages.txt of the antiX19 core edition. Maybe even include a disclaimer in helptext for main window, stating “The default exclude list is suited to downloading set of packages which are intended for later installation to an antiX19 full//base system”.

[Member Xecure]

Helpful

Up

0

::

Anonymous wrote:

Since the program’s target audience will likely be users of current antiX 19, you might consider blacklisting any package mentioned within the installed-packages.txt of the antiX19 core edition.

I think that is too aggresive, but I will add an optional antix19.2-agresive-exclude.list file just in case someone really wants to use it.

For now, for people who don’t want to keep a collection of updates, they can use the core exclude.list already there.

antiX Live system enthusiast.
General Live Boot Parameters for antiX.

[Member marcelocripe]

Helpful

Up

0

::

Xecure wrote:

So it downloaded only 63 packages compared to the previous version that was almost 300. I think this is an improvement. Hopefully the “compromise” new option will work for most programs as well.
The real test will be downloading a package from backports (like libreoffice latest), mxrepo (gimp, for example) and outside repos (ala chrome).
I didn’t have the time for testing as many packages as possible. I will really have time during the weekend.

Thanks for your feedback.

Hi Xecure,

Test with Google Chrome, using the default settings of “my-offline-repo0103-1.zip”, 52 downloaded “.deb” packages, failed right after I selected REPO google_chrome and clicked Ok, RoxTerm opens and closes quickly.

marcelocripe

———-

Olá Xecure,

Teste com o Google Chrome, usando as configurações padrões do “my-offline-repo0103-1.zip”, 52 pacotes “.deb” baixados, falhou logo após eu selecionar REPO google_chrome e clicar em Ok, o RoxTerm abre e fecha rapidamente.

marcelocripe

URL list:

ca-certificates
dbus
dbus-user-session
dconf-gsettings-backend
dconf-service
elogind
glib-networking
glib-networking-common
glib-networking-services
google-chrome-stable
gsettings-desktop-schemas
libappindicator3-1
libasound2
libasound2-data
libatk-bridge2.0-0
libatspi2.0-0
libcairo-gobject2
libcolord2
libdbus-1-3:i386
libdbusmenu-glib4
libdbusmenu-gtk3-4
libdconf1
libdrm2
libdrm-common
libepoxy0
libgbm1
libgtk-3-0
libgtk-3-common
libindicator3-7
libjson-glib-1.0-0
libjson-glib-1.0-common
liblcms2-2
libnspr4
libnss3
libpam-elogind
libpam-systemd
libpcre2-8-0
libproxy1v5
libpsl5
librest-0.7-0
libsoup2.4-1
libsoup-gnome2.4-1
libwayland-client0
libwayland-cursor0
libwayland-egl1
libwayland-server0
libx11-xcb1
libxcb-dri3-0
libxkbcommon0
libxtst6
openssl
wget
xdg-utils
xkb-data

google_chrome_amd64.repo:

INSTALL_PACKAGES=google-chrome-stable
PACKAGE_DESCRIPTION=Latest Google Chrome browser (stable)
ca-certificates
dbus
dbus-user-session
dconf-gsettings-backend
dconf-service
elogind
glib-networking
glib-networking-common
glib-networking-services
google-chrome-stable
gsettings-desktop-schemas
libappindicator3-1
libasound2
libasound2-data
libatk-bridge2.0-0
libatspi2.0-0
libcairo-gobject2
libcolord2
libdbus-1-3:i386
libdbusmenu-glib4
libdbusmenu-gtk3-4
libdconf1
libdrm2
libdrm-common
libepoxy0
libgbm1
libgtk-3-0
libgtk-3-common
libindicator3-7
libjson-glib-1.0-0
libjson-glib-1.0-common
liblcms2-2
libnspr4
libnss3
libpam-elogind
libpam-systemd
libpcre2-8-0
libproxy1v5
libpsl5
librest-0.7-0
libsoup2.4-1
libsoup-gnome2.4-1
libwayland-client0
libwayland-cursor0
libwayland-egl1
libwayland-server0
libx11-xcb1
libxcb-dri3-0
libxkbcommon0
libxtst6
openssl
wget
xdg-utils
xkb-data

0_errors.log:
seg set 21 19:37:51 -03 2020 – Errors for package google_chrome:amd64

• This reply was modified 2 years, 7 months ago by marcelocripe.

[Member marcelocripe]

Helpful

Up

0

::

Eu acho que pode ser interessante repetir alguns testes anteriores para compararmos a quantidade de pacotes baixados.

I think it may be interesting to repeat some previous tests to compare the amount of packages downloaded.

kget

kget Não é um nome de pacote válido
kget is not a valid package name

kdenlive

Pacote kdenlive não pode ser processado. Contate o desenvolvedor
Kdenlive package cannot be processed. Contact the developer

kodi

Pacote kodi
não pode ser processado. Contate o desenvolvedor
kodi package cannot be processed. Contact the developer

marcelocripe

[Member Xecure]

Helpful

Up

0

::

marcelocripe wrote:

Test with Google Chrome, using the default settings of “my-offline-repo0103-1.zip”, 52 downloaded “.deb” packages, failed right after I selected REPO google_chrome and clicked Ok, RoxTerm opens and closes quickly.

Please read my previous post:

Xecure wrote:

There was a problem downloading google-chrome […] the main culprit is the exclude.list file (it excluded libcups2 package, and it seems chrome and gimp need it).
If you change the contents of the exclude.list for the one in 19.2core-exclude (delete all text inside exclude.list, copy all content from 19.2core-exclude file, and paste it inside exclude.list and then save the file), the number of dependencies becomes larger but there are no install problems.

About your other errors:

marcelocripe wrote:

kget
kdenlive
kodi

You forgot to Remove repo from list (Remover o repo da lista) before starting to download again.
Tomorrow i think I will have the next version available.

antiX Live system enthusiast.
General Live Boot Parameters for antiX.

[Member Xecure]

Helpful

Up

0

::

Major update thanks to skidoo.

What is new in my OFFLINE repo 0.11.4
— BIG changes —
* New HELP windows for all configuration windows explaining what each option does (thanks, skidoo)
* Rewrite of many HELP window texts (thanks, skidoo)
* New “Download Updates” window. From an offline system, create a .packagelist file and save it in the packagelists folder (Already created one for base and full x64 for antiX 19.2). This .packagelist file will contain all packages (and versions) of programs installed in that offline system. Using it, the program will enable you to download all updates for that system so you can later use it to update many other systems offline (based on the same starting point).
* New option to install updates directly from “Install from repo” window.
* Major update for pt and pt_BR translations with all changes.

— Minor changes —
* Renamed configuration file to my-offline-repo.conf
* Fixed some text strings and variable names (thanks, skiddo).
* New option for “Install from Repo” wich will automatically remove the local repo from sources.list when exiting the window (to avoid complications when forgetting to remove it manually).
* New option (experimental) to download new dependencies with updates. It is a bit slow and unreliable, but it is a starting point.
* Replaced check_sudo functionality
* Some other minor changes, like replacing buttons, etc (thanks, skidoo)

I think I am close to finish now. The only things left are adding .packagelist files for x32 bits and some fixes here and there.

Attachments:

1. my-offline-repo-0114.zip

antiX Live system enthusiast.
General Live Boot Parameters for antiX.

[Member ex_Koo]

Helpful

Up

0

::

Just tried your offline repo 0.11.4.

Is the updates/downloads based on my install programs & why is Debian-backports part of the repo list ?
I did not want to install the updates just download and store them which seemed to have worked.

This is what the error log contains = Sat 26 Sep 14:11:37 AEST 2020 – Errors for Updating antix19.2.1-base:amd64

$./my-offline-repo.sh
OS architecture: amd64
Configuration file found. Importing options.

Download Updates Dialog
Check package list - /home/koo/Downloads/my-offline-repo-0114/packagelists/antix19.2.1-base_
Checking for updates
Total Updates found for antix19.2.1-base: 151
Checking for extra-updates
New extra updates: 6
smxi-inxi-antix|buster|0.4.19|0.4.21|
Error: DPKG

Download Updates Dialog
updating package list
Check package list - /home/koo/Downloads/my-offline-repo-0114/packagelists/antix19.2.1-base_
Checking for updates
Total Updates found for antix19.2.1-base: 151
Checking for extra-updates
New extra updates: 6
Downloading Updates for antix19.2.1-base
Finished downloading
Downloaded all updates properly

[Member Xecure]

Helpful

Up

0

::

Hi, Koo.

ex_Koo wrote:

Is the updates/downloads based on my install programs & why is Debian-backports part of the repo list ?

Updates are checked for the packagelist created for vanilla antiX 19.2 (base or full). That means all updates will be related to that vanilla packagelist.
For base, the original system has no packages from backports installed, but Full does (libreoffice). I have tried to make it so it will check if a package was downloaded from backports and try to find an update from backports for that software. If you think this is a bad idea, and I should avoid backports, I will remove that part of the code.

If you want updates only for your specific system (with specific packages installed or removed different from the vanilla version), you need to first generate a .packagelist file specific to your system.
apt --installed list | tail -n+2 | cut -d "[" -f 1 | sed 's/,now / /g' | sed 's/\/now /\/ /g' > koo-antiX-19_amd64.packagelist
(I think I need to add a button to generate them for the user so they don’t need to do so through the command line.)
Move that koo-antiX-19_amd64.packagelist to the packagelists folder and you can now check for updates for that specific computer.
This was initially thought for offline systems, so I didn’t think about doing it for the same system that is running the program. I think I will add the option (this system) to the dropdown box.

Thanks for testing, Koo.

antiX Live system enthusiast.
General Live Boot Parameters for antiX.

[Member ex_Koo]

Helpful

Up

0

::

Also tonight I ran apt update.

antix19 * 16 files = 23M ~ >$sudo apt update
[sudo] password for koo: 
Get:1 http://security.debian.org buster/updates InRelease [65.4 kB]
Hit:2 https://mirrors.evowise.com/mxlinux-packages/antix/buster buster InRelease    
Hit:3 http://ftp.au.debian.org/debian buster-updates InRelease
Get:4 http://ftp.au.debian.org/debian buster InRelease [121 kB]
Get:5 http://ftp.au.debian.org/debian buster/contrib i386 Packages [46.4 kB]
Get:6 http://ftp.au.debian.org/debian buster/contrib amd64 Packages [50.5 kB]
Get:7 http://ftp.au.debian.org/debian buster/main i386 Packages [7,863 kB]
Get:8 http://ftp.au.debian.org/debian buster/main amd64 Packages [7,906 kB]                                                                                                                                                                                                            
Get:9 http://ftp.au.debian.org/debian buster/main Translation-en [5,968 kB]                                                                                                                                                                                                            
Fetched 22.0 MB in 60s (365 kB/s)                                                                                                                                                                                                                                                      
Reading package lists... Done
Building dependency tree       
Reading state information... Done
19 packages can be upgraded. Run 'apt list --upgradable' to see them.
N: Repository 'http://ftp.au.debian.org/debian buster InRelease' changed its 'Version' value from '10.5' to '10.6'
antix19 * 17 files = 23M ~ >$apt list --upgradable
Listing... Done
base-files/stable 10.3+deb10u6 amd64 [upgradable from: 10.3+deb10u5]
libllvm7/stable 1:7.0.1-8+deb10u2 amd64 [upgradable from: 1:7.0.1-8]
libqt5concurrent5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5core5a/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5dbus5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5gui5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5network5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5printsupport5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5sql5-sqlite/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5sql5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5test5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5widgets5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libqt5xml5/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]
libx11-6/stable 2:1.6.7-1+deb10u1 amd64 [upgradable from: 2:1.6.7-1]
libx11-data/stable,stable 2:1.6.7-1+deb10u1 all [upgradable from: 2:1.6.7-1]
libx11-dev/stable 2:1.6.7-1+deb10u1 amd64 [upgradable from: 2:1.6.7-1]
libx11-xcb1/stable 2:1.6.7-1+deb10u1 amd64 [upgradable from: 2:1.6.7-1]
linux-libc-dev/stable 4.19.146-1 amd64 [upgradable from: 4.19.132-1]
qt5-gtk-platformtheme/stable 5.11.3+dfsg1-1+deb10u4 amd64 [upgradable from: 5.11.3+dfsg1-1+deb10u3]

[Member ex_Koo]

Helpful

Up

0

::

Thank You
Having updates only for my system is better then expected. This is Awesome and so are You.

[Author]

Posts