一个python脚本，把一个目录下所有文件转成utf8编码

chardet package is in gentoo-china-overlay
layman -a gentoo-china
I have already filed a chardet's bug, requesting it to be added to portage
However, no response yet

#! /usr/bin/python
import sys,chardet,shutil,os,tempfile

def convert(fname):
        fp = open(fname)
        text = fp.read()
        encoding = chardet.detect(text)['encoding']
        rate = chardet.detect(text)['confidence']
        if rate > 0.9 and not encoding == 'utf-8':
                tmp,tmpname=tempfile.mkstemp()
                os.write(tmp, unicode(text,encoding).encode('utf-8'))
                shutil.move(tmpname, fname)

if __name__=="__main__":
        dir = sys.argv[1]
        for f in os.listdir(dir):
                pathname = os.path.join(dir, f)
                convert(pathname)

Comments

Post a Comment

Popular posts from this blog

The diff between the original SEC complaint against Ripple and the amended one

--- original.txt 2021-02-18 18:32:43.171832036 -0800 +++ amended.txt 2021-02-18 18:32:29.103735165 -0800 @@ -1,4 +1,4 @@ -Case 1:20-cv-10832 Document 4 Filed 12/22/20 Page 1 of 71 +Case 1:20-cv-10832-AT Document 46 Filed 02/18/21 Page 1 of 79 Richard Best Kristina Littman @@ -34,9 +34,9 @@ : ------------------------------------------------------------------------x -20 Civ. 10832 +20 Civ. 10832 (AT) ECF Case -Complaint +First Amended Complaint Jury Trial Demanded Plaintiff Securities and Exchange Commission (the “SEC”), for its Complaint against @@ -53,7 +53,7 @@ required by the federal securities laws, and no exemption from this requirement applied. 1 -Case 1:20-cv-10832 Document 4 Filed 12/22/20 Page 2 of 71 +Case 1:20-cv-10832-AT Document 46 Filed 02/18/21 Page 2 of 79 2. @@ -103,7 +103,7 @@ 2 -Case 1:20-cv-10832 Document 4 Filed 12/22/20 Page 3 of 71 +Case 1:20-cv-10832-AT Document 46 Filed 02/18/21 Page 3 of 79 VIOLATIONS 9. @@ -150,
Read more

Send $SGB (Songbird) to another wallet using a script

You need nodejs and web3 to run it:  const Web3 = require('web3'); // Variables definition const privKey = '8xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx2'; // Genesis private key const addressFrom = '0xAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA'; const addressTo = '0xBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB'; const web3 = new Web3('https://songbird.towolabs.com/rpc'); // Create transaction const deploy = async () => { console.log( `Attempting to make transaction from ${addressFrom} to ${addressTo}` ); const createTransaction = await web3.eth.accounts.signTransaction( { from: addressFrom, to: addressTo, value: web3.utils.toWei('1', 'ether'), // Send 1 SGB. 'ether' is not a typo here. gasPrice: web3.utils.toWei('225', 'Gwei'), gas: '21000', }, privKey ); // Deploy transaction const createR
Read more

Rippled thread cpu usage

Image
The cpu usage of xrp.ninja validator spikes every 2 hours. I always wonder what it is doing during the spikes. So I wrote a script to report the thead cpu usage to a statsd server.  I started statsd/graphite/grafana using  https://github.com/ripple/rippledmon Then I wrote this script: #!/usr/bin/python3 import collections import itertools import os import re import statsd import subprocess import time HEADER = b'%CPU COMMAND' STATSD = 'XXX' PORT = 'YYY' PREFIX = 'rippled.threads' TOP = 'env HOME={0} top -b -n 1 -p $(pgrep rippled) -H'.format(os.getcwd()) def report(c, jobs): p = subprocess.run(TOP, shell=True, stdout=subprocess.PIPE, stderr=subprocess.PIPE) if p.returncode != 0: print(p.stderr) return m = collections.defaultdict(float) for line in itertools.dropwhile(lambda x: x != HEADER, p.stdout.splitlines()): if line == HEADER: continue usage, comm = line.decode().str
Read more