将python 3多线程输出到CSV文件（空白）

clonerworks 发表于 Dev

克隆工厂

我是python的新手，我从遇到的教程中获得了此多线程功能。不确定是否可以练习。

我要存档的内容：ping主机名列表，然后向上或向下返回。将结果写入CSV文件

该文件当前执行的操作是：ping主机名列表并向上或向下返回。它创建的csv文件为空，并且似乎没有向其写入任何结果。

我进行了一些测试，发现使用pings multithreadin进行串行代码处理对我来说快了大约16倍。我正在做大量的ping大约9000，并希望它们尽快返回。

您能告诉我我在csv部分出错了吗？

import threading
from queue import Queue
import time
import subprocess as sp
import csv

# lock to serialize console output
lock = threading.Lock()

def do_work(item):
    #time.sleep(1) # pretend to do some lengthy work.
    # Make sure the whole print completes or threads can mix up output in one line.

    status,result = sp.getstatusoutput("ping -n 3 " + str(item))
    if status == 0:
        result = 'Up'
    else:
        result = 'Down'

    with lock:
        output.writerow({'hostname': item,'status': result})
        array.append({'hostname': item,'status': result})
        print(threading.current_thread().name,item,result)

# The worker thread pulls an item from the queue and processes it
def worker():
    while True:
        item = q.get()
        do_work(item)
        q.task_done()

# Create the queue and thread pool.
q = Queue()
for i in range(100):
     t = threading.Thread(target=worker)
     t.daemon = True  # thread dies when main thread (only non-daemon thread) exits.
     t.start()

array = []
# stuff work items on the queue (in this case, just a number).
start = time.perf_counter()

headers = ['status','hostname']
output = csv.DictWriter(open('host-export.csv','w'), delimiter=',', lineterminator='\n', fieldnames=headers)
output.writeheader()

txt = open("hosts.txt", 'r', encoding="utf8")
for line in txt:
    q.put(line,array)

q.join()       # block until all tasks are done

# "Work" took .1 seconds per task.
# 20 tasks serially would be 2 seconds.
# With 4 threads should be about .5 seconds (contrived because non-CPU intensive "work")
print(array)

print('time:',time.perf_counter() - start)

我还为csv添加了大量文字，以为我可能无法访问该函数中的csv对象，但这也无法正常工作，如下所示。

headers = ['status','hostname']
output = csv.DictWriter(open('host-export.csv','w'), delimiter=',', lineterminator='\n', fieldnames=headers)
output.writeheader()
output.writerows(array)

克隆工厂

我弄错了我做错了什么。我没有关闭文件连接，所以它没有写入文件。

这是我现在用来定位我的csv文件的代码。

fieldnames = ['ip', 'dns', 'pings'] #headings 
test_file = open('test2-p.csv','w', newline='') #open file
csvwriter = csv.DictWriter(test_file, delimiter=',', fieldnames=fieldnames) #set csv writing settings
csvwriter.writeheader() #write csv headings 
for row in rows: #write to csv file
     csvwriter.writerow(row)
test_file.close()

本文收集自互联网，转载请注明来源。

如有侵权，请联系[email protected] 删除。