python - How to compare hdfs file with unix file? -

-

I want to compare the HDFS file with the Unix file. I know that using the cat command in the same way we can compare the files because the cat command is provided by the Hadoop Distributed File System (HDFS).

Let's take an example: 

  # hdfs dfs -ls -r / demo-rw-r-r-- 3 root hdfs 129617 2014-10-17 12 : 22 /demo/abc.log #l / tmp xyz.log

I want to compare abc.log here. Code> to xyz.log . Any better approach ??

You can probably use shell redirection + diff 

  diff & lt; (Hdfs dfs -cat / demo / abc.log) & lt; (Cat /tmp/xyz.log)

Comments

Post a Comment

Popular posts from this blog

python - Strange behavior using PyQt4's 'pyqtSlot' decorator before another decorator -

-
I have a strange problem with using the QtCore.pyqtSlot decorator in front of the function decorated with a different decorator. The problem below shows this problem, it immediately provides a low QT program with a single button. When pressing a button, the following happens: (1) The signal 'signal_A' and 'signal_B' sequence are connected to method_A and method_B ​​respectively. (2) signal_A and signal_B signals are emitted. (3) The required behavior is that the method_A and method_B ​​are executed. However, it turns out that both signal_A and signal_B trigger method_A, or method_B ​​(oddly, this is nondeterministic, and different for each part of the program!). It appears to be a bug. This issue is present when PyQt4 binding is used in Qt. It is not present when using PySide (use the '-pyside' parameter to verify) I have seen both problems in Python 2 and 3, and both in Windows and Linux This issue is related to the insertion of a decorator be...
Read more

c# - UnhandledExceptionMode.ThrowException for AppDomain.UnhandledException -

-
I want to set unhandledExceptionMode.ThrowException for current AppDomain and not only for application threads. An exception from the second thread should also be handled by my current Donan_Unimated exception handler. Is it possible? Here's my code: Fixed class program {/// & lt; Summary & gt; Main entry point for the application /// & lt; / Summary & gt; [STAThread] static zero major () {applications Set unhandled exception mode (unwanted exception. Throws up); AppDomain.CurrentDomain.UnhandledException + = New UnrestrictedExceptionEndception (CurrentDomain_UnhandledException); Application.EnableVisualStyles (); Application.SetCompatibleTextRenderingDefault (wrong); Application.Run (New Form 1 ()); } Static Zero CurrentDomain_UnhandledException (Object Sender, UnhandledExceptionEventArgs E) {File.AppendAllText ("Log.txt", (Exception) e.ExceptionObject). Message + environment. Newline); }} Maybe you search for the behavior provided by Applic...
Read more

c# - Process.Kill() returns access denied -

-
I'm trying to kill a process using a CMD command line from my C # application, but when I start the application does not happen anything. .. When I try to kill with a command prompt, I get the message: "Access denied" I tried to run as my app administrator and the process was killed. How can I not always use "Run as administrator"? Code: System.Diagnostics.Process process = new System.Diagnostics.Process (); System.Diagnostics.ProcessStartInfo startInfo = New system. Diagnostics. Process STARTINFO (); StartInfo.WindowStyle = System.Diagnostics.ProcessWindowStyle.Hidden; StartInfo.FileName = "cmd.exe"; StartInfo.Arguments = "/ C Tasky / F / IM APP.exe"; Process.start.info = startInfo; Process.start (); try it System.Diagnostics.Process Process = new system Diagnostics Process (); System.Diagnostics.ProcessStartInfo startInfo = New system. Diagnostics. Process STARTINFO (); StartInfo.WindowStyle = System.Diagnostics.ProcessWindowS...
Read more