uBlock/tools/make-assets.sh

#!/usr/bin/env bash
#
# This script assumes a linux environment

DES=$1/assets

printf "*** Packaging assets in $DES... "

if [ -n "${TRAVIS_TAG}" ]; then
  pushd .. > /dev/null
  git clone --depth 1 https://github.com/uBlockOrigin/uAssets.git
  popd > /dev/null
fi

rm -rf $DES
cp -R ./assets $DES/

mkdir $DES/thirdparties
cp -R ../uAssets/thirdparties/easylist-downloads.adblockplus.org $DES/thirdparties/
cp -R ../uAssets/thirdparties/pgl.yoyo.org                       $DES/thirdparties/
cp -R ../uAssets/thirdparties/publicsuffix.org                   $DES/thirdparties/
cp -R ../uAssets/thirdparties/urlhaus-filter                     $DES/thirdparties/

mkdir $DES/ublock
cp -R ../uAssets/filters/*                                       $DES/ublock/
# Optional filter lists: do not include in package
rm    $DES/ublock/annoyances.txt

echo "done."
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00			`#!/usr/bin/env bash`
			`#`
			`# This script assumes a linux environment`

			`DES=$1/assets`

this fixes #1531 2016-04-03 23:45:02 +02:00			`printf "*** Packaging assets in $DES... "`
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00
this fixes travis? 2016-04-03 20:25:56 +02:00			`if [ -n "${TRAVIS_TAG}" ]; then`
prevent pushd/popd from polluting output 2016-04-04 00:06:19 +02:00			`pushd .. > /dev/null`
shallow clone uAssets in travis build 2018-01-09 23:57:40 +01:00			`git clone --depth 1 https://github.com/uBlockOrigin/uAssets.git`
prevent pushd/popd from polluting output 2016-04-04 00:06:19 +02:00			`popd > /dev/null`
this fixes travis? 2016-04-03 20:25:56 +02:00			`fi`

update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00			`rm -rf $DES`
Finalize converting resources.txt into immutable resources With hindsight, I revised decisions made earlier during this development cycle: Un-redirectable scriptlets have been removed from /web_accessible_resources and instead put in the new /assets/resources/scriptlets.js, which contains all scriptlets used for web page injection purpose. uBO will no longer fetch a remote version of built-in resources. Advanced setting `userResourcesLocation` will still be honoured by uBO, and if set, will be fetched every time at least one asset is updated. 2019-07-06 18:36:28 +02:00			`cp -R ./assets $DES/`
Leverage whotracks.me's huge dataset of URLs for benchmark purpose As seen at: https://whotracks.me/blog/adblockers_performance_study.html The requests.json.gz file can be downloaded from: https://cdn.cliqz.com/adblocking/requests_top500.json.gz Copy the file into ./tmp/requests.json.gz If the file is present when you build uBO using `make-[target].sh` from the shell, the resulting package will contain `./assets/requests.json`, which will be looked-up by the method below to launch a benchmark session. From uBO's dev console, launch the benchmark: µBlock.staticNetFilteringEngine.benchmark(); The usual browser dev tools can be used to obtain useful profiling data, i.e. start the profiler, call the benchmark method from the console, then stop the profiler when it completes. Keep in mind that the measurements at the blog post above where obtained with ONLY EasyList. The CPU reportedly used was: https://www.cpubenchmark.net/cpu.php?cpu=Intel+Core+i7-6600U+%40+2.60GHz&id=2608 Rename ./tmp/requests.json.gz to something else if you no longer want ./assets/requests.json in the build. 2019-02-15 22:18:03 +01:00
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00			`mkdir $DES/thirdparties`
			`cp -R ../uAssets/thirdparties/easylist-downloads.adblockplus.org $DES/thirdparties/`
			`cp -R ../uAssets/thirdparties/pgl.yoyo.org $DES/thirdparties/`
			`cp -R ../uAssets/thirdparties/publicsuffix.org $DES/thirdparties/`
Replace seemingly abandoned malware lists with urlhaus list Related issues: - https://github.com/uBlockOrigin/uBlock-issues/issues/1116 - https://github.com/uBlockOrigin/uBlock-issues/issues/984 It has been found that the two malware lists uBO uses by default appear to be essentially no longer maintained. urlhaus list[1] has been identified by the community as being well maintained and as being actually useful as a default malware-related list in uBO, since it's being updated every day from a database of top domains and specific URLs identified as serving malicious content. Additionally, the maintainer of urlhaus list has taken steps to increase compatibility with uBO[2]. The decision has been to replace the current two malware- related lists with urlhaus list, which will be enabled by default in uBO -- and this means that list will be part of uBO's package from now on. For those who have the two removed malware lists enabled, these will be moved to the custom lists section -- they will still be enabled. It is suggested users remove them from their selection of lists as their usefulness at this point is questionable. [1] https://gitlab.com/curben/urlhaus-filter [2] https://gitlab.com/curben/urlhaus-filter/-/commit/859dfd03c6e9e5af6f1fac29bc9b22d1e0046111 2020-07-06 15:03:20 +02:00			`cp -R ../uAssets/thirdparties/urlhaus-filter $DES/thirdparties/`
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00
			`mkdir $DES/ublock`
			`cp -R ../uAssets/filters/* $DES/ublock/`
do not include optional annoyances.txt in extension package 2017-12-17 15:42:24 +01:00			`# Optional filter lists: do not include in package`
			`rm $DES/ublock/annoyances.txt`
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 19:07:46 +02:00
this fixes #1531 2016-04-03 23:45:02 +02:00			`echo "done."`